360 Degree Camera Apparatus and Monitoring System

ABSTRACT

Systems and methods include a camera apparatus. The camera apparatus includes a mounting base and a plurality of sensors. The mounting base is adapted to mount to a structure. The plurality of sensors includes an array of image sensors arranged to simultaneously capture a combined 360 degree view around the camera apparatus.

CROSS-REFERENCE TO RELATED APPLICATION(S)

The present patent/application is continuation-in-part of and thecontent of each are incorporated by reference herein:

Filing Date Serial No. Title Jan. 23, 16/750,301 Systems and methods forperforming a Passive 2020 Intermodulation mitigation audit at a wirelesssite May 1, 15/968,131 Systems and methods for delivering a close out2018 package for work done at a telecommunications site Mar. 20,15/926,533 Systems and methods for closing out 2018 maintenance orinstallation work at a telecommunications site Feb. 19, 15/898,695Systems and methods for data capture for 2018 telecommunications sitemodeling via a telescoping apparatus Aug. 12, 15/235,686 Telescopingplatform for operations on cell 2016 towers Jan. 23, 15/877,555 Systemsand methods for satellite data capture 2018 for telecommunications sitemodeling Nov. 17, 15/815,786 Augmented reality systems and methods for2017 telecommunications site modeling Aug. 14, 15/675,930 Virtual360-degree view of a 2017 telecommunications site Oct. 3, 15/283,699Obtaining 3D modeling data using UAVs for 2016 cell sites Aug. 19,15/241,239 3D modeling of cell sites to detect 2016 configuration andsite changes May 31, 15/168,503 Virtualized site survey systems andmethods for 2016 cell sites May 20, 15/160,890 3D modeling of cell sitesand cell towers with 2016 unmanned aerial vehicles Apr. 14, 14/685,720Unmanned aerial vehicle-based systems and 2015 methods associated withcell sites and cell towers

FIELD OF THE DISCLOSURE

The present disclosure relates generally to commercial site monitoringsystems and methods. More particularly, the present disclosure relatesto systems and methods for monitoring the commercial site using a cameraapparatus adapted to simultaneously capture a combined 360 degree viewof a location at the commercial site.

BACKGROUND OF THE DISCLOSURE

Due to the geographic coverage nature of wireless service, there arehundreds of thousands of cell towers in the United States. For example,in 2014, it was estimated that there were more than 310,000 cell towersin the United States. Cell towers can have heights up to 1,500 feet ormore. There are various requirements for cell site workers (alsoreferred to as tower climbers or transmission tower workers) to climbcell towers to perform maintenance, audit, and repair work for cellularphone and other wireless communications companies. This is both adangerous and costly endeavor. For example, between 2003 and 2011, 50tower climbers died working on cell sites (see, e.g.,www.pbs.org/wgbh/pages/frontline/social-issues/cell-tower-deaths/in-race-for-better-cell-service-men-who-climb-towers-pay-with-their-lives/).Also, OSHA estimates that working on cell sites is 10 times moredangerous than construction work, generally (see, e.g.,www.propublica.org/article/cell-tower-work-fatalities-methodology).Furthermore, the tower climbs also can lead to service disruptionscaused by accidents. Thus, there is a strong desire, from both a costand safety perspective, to reduce the number of tower climbs and toreduce the number of site visits.

BRIEF DESCRIPTION OF THE DRAWINGS

The present disclosure is illustrated and described herein withreference to the various drawings, in which like reference numbers areused to denote like system components/method steps, as appropriate, andin which:

FIG. 1 is a diagram of a side view of an example cell site;

FIG. 2 is a diagram of a cell site audit performed with a UAV;

FIG. 3 is a screen diagram of a view of a graphical user interface (GUI)on a mobile device while piloting the UAV;

FIG. 4 is a perspective view of an example UAV;

FIG. 5 is a block diagram of a mobile device;

FIG. 6 is a flowchart of a cell site audit method utilizing the UAV andthe mobile device;

FIG. 7 is a network diagram of various cell sites deployed in ageographic region;

FIG. 8 is a diagram of the cell site and an associated launchconfiguration and flight for the UAV to obtain photos for a 3D model ofthe cell site;

FIG. 9 is a satellite view of an example flight of the UAV at the cellsite;

FIG. 10 is a side view of an example flight of the UAV at the cell site;

FIG. 11 is a logical diagram of a portion of a cell tower along withassociated photos taken by the UAV at different points relative thereto;

FIG. 12 is a screenshot of a GUI associated with post-processing photosfrom the UAV;

FIG. 13 is a screenshot of a 3D model constructed from a plurality of 2Dphotos taken from the UAV as described herein;

FIGS. 14-19 are various screenshots of GUIs associated with a 3D modelof a cell site based on photos taken from the UAV as described herein;

FIG. 20 is a photo of the UAV in flight at the top of a cell tower;

FIG. 21 is a flowchart of a method for modeling a cell site with anUnmanned Aerial Vehicle (UAV);

FIG. 22 is a diagram of an example interior of a building, such as ashelter or cabinet, at the cell site;

FIG. 23 is a flowchart of a virtual site survey method for the cellsite;

FIG. 24 is a flowchart of a close-out audit method performed at a cellsite subsequent to maintenance or installation work;

FIG. 25 is a flowchart of a 3D modeling method to detect configurationand site changes;

FIG. 26 is a flow diagram of a 3D model creation method;

FIG. 27 is a flowchart of a method using an Unmanned Aerial Vehicle(UAV) to obtain data capture at a cell site for developing a threedimensional (3D) thereof;

FIG. 28 is a flowchart of a 3D modeling method for capturing data at thecell site, the cell tower, etc. using the UAV;

FIGS. 29A and 29B are block diagrams of a UAV with multiple cameras(FIG. 29A) and a camera array (FIG. 29B);

FIG. 30 is a flowchart of a method using multiple cameras to obtainaccurate three-dimensional (3D) modeling data;

FIGS. 31 and 32 are diagrams of a multiple camera apparatus and use ofthe multiple camera apparatus in a shelter or cabinet or the interior ofa building;

FIG. 33 is a flowchart of a data capture method in the interior of abuilding using the multiple camera apparatus;

FIG. 34 is a flowchart of a method for verifying equipment andstructures at the cell site using 3D modeling;

FIG. 35 is a diagram of a photo stitching User Interface (UI) for cellsite audits, surveys, inspections, etc. remotely;

FIG. 36 is a flowchart of a method for performing a cell site audit orsurvey remotely via a User Interface (UI);

FIG. 37 is a perspective diagram of a 3D model of the cell site, thecell tower, the cell site components, and the shelter or cabinet alongwith surrounding geography and subterranean geography;

FIG. 38 is a flowchart of a method for creating a three-dimensional (3D)model of a cell site for one or more of a cell site audit, a sitesurvey, and cell site planning and engineering;

FIG. 39 is a perspective diagram of the 3D model of FIG. 37 of the cellsite, the cell tower, the cell site components, and the shelter orcabinet along with surrounding geography, subterranean geography, andincluding fiber connectivity;

FIG. 40 is a flowchart of a method for creating a three-dimensional (3D)model of a cell site and associated fiber connectivity for one or moreof a cell site audit, a site survey, and cell site planning andengineering;

FIG. 41 is a perspective diagram of a cell site with the surroundinggeography;

FIG. 42 is a flowchart of a method for cell site inspection by a cellsite operator using the UAV;

FIG. 43 is a flowchart of a virtual 360 view method 2700 for creatingand using a virtual 360 environment;

FIGS. 44-55 are screenshots from an example implementation of thevirtual 360-degree view environment from FIG. 43;

FIG. 56 is a flowchart of a virtual 360 view method for creating,modifying, and using a virtual 360 environment;

FIGS. 57 and 58 are screenshots of a 3D model of a telecommunicationssite of a building roof with antenna equipment added in the modified 3Dmodel;

FIG. 59 is a flowchart of a scanning method for incorporating an objectin a virtual view;

FIG. 60 is a flowchart of a model creation method for incorporating avirtually created object in a virtual view;

FIG. 61 is a diagram of various satellites in orbit around the Earth foruse in data collection for the 3D model;

FIG. 62 is a flowchart of a 3D modeling method for capturing data at thecell site, the cell tower, etc. using one or more satellites;

FIG. 63 is a perspective diagram of a mobile unit with a telescopingapparatus for data capture in a transport position;

FIG. 64 is a perspective diagram of the mobile unit with the telescopingapparatus in the process of raising in an operating position;

FIG. 65 is a perspective diagram of the telescoping apparatus in amobile configuration to maneuver at the cell site;

FIG. 66 is a perspective diagram of the telescoping apparatus with ascissor lift mechanism; and

FIG. 67 is a flowchart of a method for closing out maintenance orinstallation work at a telecommunication site;

FIG. 68 is a flowchart of a method for creating a 3D model of atelecommunications site and performing an augmented reality add-in ofequipment, structures, etc. at the telecommunications site;

FIG. 69 is a flowchart of a workflow to share a data package (e.g., the3D model) with an end user;

FIG. 70 is a screenshot of a User Interface;

FIG. 71 is a flowchart of a method for performing a PIM mitigationaudit;

FIG. 72 is a perspective diagram of a monitoring system;

FIG. 73 is a side perspective diagram of a cell tower 7300 with 360degree camera apparatuses 7220 mounted thereon;

FIG. 74 is a block diagram of a 360 degree camera apparatuses, which maybe used with the monitoring system;

FIG. 75 is a block diagram of a server, which may be used in themonitoring system;

FIG. 76 is a flowchart of a method for monitoring a commercial location;

FIG. 77 is a flowchart of a method for monitoring a commercial location;

FIG. 78 is a flowchart of a method for monitoring a commercial location;

FIG. 79 is a flowchart of a method for monitoring a multiple locations;and

FIG. 80 is a flowchart of a method for monitoring a cell tower.

DETAILED DESCRIPTION OF THE DISCLOSURE

The present disclosure relates to systems and methods for monitoringcommercial sites, such as telecommunications sites including celltowers, and the like. The monitoring system includes a camera apparatusthat is adapted to simultaneously capture a combined 360 degree view ofa location at the commercial site, such as within a structure housingequipment, a portion of a cell tower, and the like. As such, at anymoment, a user can access the camera apparatus and obtain any one of ormultiple views of the 360 degree view, such as multiple views stitchedtogether, to monitor the location.

Along with at least an array of image sensors for capturing the 360degree view, the sensors of the camera apparatus can include light,infrared, sound, motion, and RF sensors. As such, robust monitoring ofthe location and equipment therein can be performed, such as monitoringfor intrusion, taking measurements, and equipment monitoring, such asthermographic and noise monitoring. Further, the sensors can be used togenerate a 360 degree model of the location and data from the model andthe sensors can be used to generate an augmented reality view of thelocation, such as by displaying dimensions, equipment information,equipment temperatures, and the like. Due to the ever present andstreaming nature of the camera apparatus, the model can be updated ondemand, at any time or on a predetermined interval, to ensure that theaugmented reality view is up to date.

Further, the present disclosure relates to systems and methods forperforming a Passive Intermodulation (PIM) mitigation audit at awireless site. The PIM mitigation audit can be performed based onvarious measurements that can be obtained via data capture through anUnmanned Aerial Vehicle (UAV) (“drones”), satellite data capture, planedata capture, ground-based data capture, etc. along with athree-dimensional (3D) model. The objective of such a PIM mitigationaudit is to determine PIM risks, without requiring physical testing,without requiring tower climbs, etc.

Further, the present disclosure relates to systems and methods for anaugmented reality add-in of equipment and structures at atelecommunications site. Further, the present disclosure relates tosystems and methods for data capture for telecommunication site modelingsuch as three-dimensional (3D) modeling for engineering and planning viaa telescoping apparatus. The systems and methods utilize the telescopingapparatus with a camera attached thereto to obtain data capture for a 3Dmodel. Specifically, the systems and methods include a telescopingapparatus, a mobile unit with the telescoping apparatus, and anassociated method for 3D modeling. Conventional approaches rely onground-based data capture, i.e., high-performance digital cameras withzoom. However, this data capture at the top or middle of the cell toweris at an angle which is the same angle around a 360-degree view of thecell tower. This causes difficulty in creating the 3D model as thecamera is not parallel to the object of interest or able to change theangle of the data capture of the object of interest.

Further, the present disclosure relates to systems and methods forsatellite data capture for telecommunication site modeling such as 3Dmodeling for engineering and planning. Specifically, the systems andmethods can utilize satellites to obtain photos/video of a cell site.With this data capture and optionally with other data capture such asvia Unmanned Aerial Vehicles (UAVs), site visits, etc., the data captureis used to develop a 3D model of the telecommunications site.Advantageously, the satellite data capture can provide highly detailedphotographs and removes the requirement for site visits which is keygiven the number of cell sites. The 3D model can be used for variousfunctions related to planning, engineering, installation, and the like.

Further, the present disclosure relates to augmented reality systems andmethods for telecommunication site engineering and planning. With theaugmented reality systems and methods, a user can incorporate 3D objectsinto a virtual model via data capture from a phone, a tablet, a digitalcamera, etc. including a digital camera on a UAV, small UnmannedAircraft System (sUAS), etc. The systems and methods include techniquesto scan objects to create virtual objects and to incorporate the virtualobjects in existing views. For example, a cell tower and the like can bevirtually placed in an augmented reality view. The systems and methodsalso include techniques for 3D model creation. Variously, the systemsand methods can be used for a cell site or other telecommunication sitesfor planning, engineering, installation, and the like.

Further, the present disclosure relates to systems and methods for avirtual 360-degree view modification of a telecommunications site, suchas a cell site, for purposes of planning, engineering, and installation,and the like. The systems and methods include a 3D model of thetelecommunications site, including exterior and surrounding geography aswell as internal facilities. Various techniques are utilized for datacapture including the use of a UAV. With the 3D model, variousmodifications and additions are added after the fact, i.e., to apreexisting environment, for the purposes of planning, engineering, andinstallation. Advantageously, the modified 3D model saves time in siteinspection and engineering, improves the accuracy of planning andinstallation, and decreases the after installation changes increasingthe overall planning phase of construction and telecommunicationoperations.

Further, the present disclosure relates to systems and methods for avirtual 360-degree view of a telecommunications site, such as a cellsite, for purposes of site surveys, site audits, and the like. Theobjective of the virtual 360 view is to provide an environment, viewablevia a display, where personnel can be within the telecommunications siteremotely. That is, the purpose of the virtual 360 view creation is toallow industry workers to be within the environment of the locationcaptured (i.e., cellular telecommunications site). Within thisenvironment, there is an additional augmented reality where a user cancall information from locations of importance. This environment canserve as a bid walk, pre-construction verification, post-installationverification, or simply as an inventory measurement for companies. Theinformation captured with the virtual 360 view captures the necessaryinformation to create action with respect to maintenance, upgrades, orthe like. This actionable information creates an environment that can bepassed from tower owner, carrier owner, construction company, andinstallation crews with the ease of an email with a Uniform ResourceLocator (URL) link to the web. This link can be sent to a user's phone,Virtual Reality (VR) headset, computer, tablet, etc. This allows for atelecom engineer to be within the reality of the cell site ortelecommunications site from their desk. For example, the engineer canclick on an Alternating Current (AC) panel and a photo is overlaid inthe environment showing the engineer the spaces available for additionalbreakers or the sizes of breakers being used.

Further, the present disclosure relates to systems and methods forverifying cell sites using accurate 3D modeling data. In an embodiment,systems and method for verifying a cell site utilizing an UAV includeproviding an initial point cloud related to the cell site to the UAV;developing a second point cloud based on current conditions at the cellsite, wherein the second point cloud is based on data acquisition usingthe UAV at the cell site; detecting variations between the initial pointcloud and the second point cloud; and, responsive to detecting thevariations, determining whether the variations are any of compliancerelated, load issues, and defects associated with any equipment orstructures at the cell site.

Further, the present disclosure relates to systems and methods forobtaining accurate 3D modeling data using a multiple camera apparatus.Specifically, the multiple camera apparatus contemplates use in ashelter or the like to simultaneously obtain multiple photos forpurposes of developing a 3D model of the shelter for use in a cell siteaudit or the like. The multiple camera apparatus can be portable ormounted within the shelter. The multiple camera apparatus includes asupport beam with a plurality of cameras associated therewith. Theplurality of cameras each face a different direction, angle, zoom, etc.and are coordinated to simultaneously obtain photos. Once obtained, thephotos can be used to create a 3D model. Advantageously, the multiplecamera apparatus streamlines data acquisition time as well as ensuresthe proper angles and photos are obtained. The multiple camera apparatusalso is simple to use allowing untrained technicians the ability toeasily perform data acquisition.

Further, the present disclosure relates to systems and methods forobtaining 3D modeling data using UAVs (also referred to as “drones”) orthe like at cell sites, cell towers, etc. Variously, the systems andmethods describe various techniques using UAVs or the like to obtaindata, i.e., pictures and/or video, used to create a 3D model of a cellsite subsequently. Various uses of the 3D model are also describedincluding site surveys, site monitoring, engineering, etc.

Further, the present disclosure relates to virtualized site surveysystems and methods using 3D) modeling of cell sites and cell towerswith and without unmanned aerial vehicles. The virtualized site surveysystems and methods utilizing photo data capture along with locationidentifiers, points of interest, etc. to create 3D modeling of allaspects of the cell sites, including interiors of buildings, cabinets,shelters, huts, hardened structures, etc. As described herein, a sitesurvey can also include a site inspection, cell site audit, or anythingperformed based on the 3D model of the cell site including buildinginteriors. With the data capture, 3D modeling can render a completelyvirtual representation of the cell sites. The data capture can beperformed by on-site personnel, automatically with fixed, networkedcameras, or a combination thereof. With the data capture and theassociated 3D model, engineers and planners can perform site surveys,without visiting the sites leading to significant efficiency in cost andtime. From the 3D model, any aspect of the site survey can be performedremotely including determinations of equipment location, accuratespatial rendering, planning through drag and drop placement ofequipment, access to actual photos through a Graphical User Interface,indoor texture mapping, and equipment configuration visualizationmapping the equipment in a 3D view of a rack.

Further, the present disclosure relates to 3D modeling of cell sites andcell towers with unmanned aerial vehicles. The present disclosureincludes UAV-based systems and methods for 3D modeling and representingof cell sites and cell towers. The systems and methods include obtainingvarious pictures via a UAV at the cell site, flying around the cell siteto obtain various different angles of various locations, tracking thevarious pictures (i.e., enough pictures to produce an acceptable 3Dmodel, usually hundreds, but could be more) with location identifiers,and processing the various pictures to develop a 3D model of the cellsite and the cell tower. Additionally, the systems and methods focus onprecision and accuracy ensuring the location identifiers are as accurateas possible for the processing by using multiple different locationtracking techniques as well as ensuring the UAV is launched from thesame location and/or orientation for each flight. The same locationand/or orientation, as described herein, was shown to provide moreaccurate location identifiers versus arbitrary location launches andorientations for different flights. Additionally, once the 3D model isconstructed, the systems and methods include an application whichenables cell site owners and cell site operators to “click” on anylocation and obtain associated photos, something extremely useful in theongoing maintenance and operation thereof. Also, once constructed, the3D model is capable of various measurements including height, angles,thickness, elevation, even Radio Frequency (RF), and the like.

§ 1.0 Example Cell Site

FIG. 1 is a diagram of a side view of an example cell site 10. The cellsite 10 includes a cell tower 12. The cell tower 12 can be any type ofelevated structure, such as 100-200 feet/30-60 meters tall. Generally,the cell tower 12 is an elevated structure for holding cell sitecomponents 14. The cell tower 12 may also include a lightning rod 16 anda warning light 18. Of course, there may various additional componentsassociated with the cell tower 12 and the cell site 10 which are omittedfor illustration purposes. In this embodiment, there are four sets 20,22, 24, 26 of cell site components 14, such as for four differentwireless service providers. In this example, the sets 20, 22, 24 includevarious antennas 30 for cellular service. The sets 20, 22, 24 aredeployed in sectors, e.g., there can be three sectors for the cell sitecomponents—alpha, beta, and gamma. The antennas 30 are used to bothtransmit a radio signal to a mobile device and receive the signal fromthe mobile device. The antennas 30 are usually deployed as a single,groups of two, three or even four per sector. The higher the frequencyof spectrum supported by the antenna 30, the shorter the antenna 30. Forexample, the antennas 30 may operate around 850 MHz, 1.9 GHz, and thelike. The set 26 includes a microwave dish 32 which can be used toprovide other types of wireless connectivity, besides cellular service.There may be other embodiments where the cell tower 12 is omitted andreplaced with other types of elevated structures such as roofs, watertanks, etc.

§ 2.0 Cell Site Audits Via UAV

FIG. 2 is a diagram of a cell site audit 40 performed with an unmannedaerial vehicle (UAV) 50. As described herein, the cell site audit 40 isused by service providers, third-party engineering companies, toweroperators, etc. to check and ensure proper installation, maintenance,and operation of the cell site components 14 and shelter or cabinet 52equipment as well as the various interconnections between them. From aphysical accessibility perspective, the cell tower 12 includes aclimbing mechanism 54 for tower climbers to access the cell sitecomponents 14. FIG. 2 includes a perspective view of the cell site 10with the sets 20, 26 of the cell site components 14. The cell sitecomponents 14 for the set 20 include three sectors—alpha sector 54, betasector 56, and gamma sector 58.

In an embodiment, the UAV 50 is utilized to perform the cell site audit40 in lieu of a tower climber access the cell site components 14 via theclimbing mechanism 54. In the cell site audit 40, an engineer/technicianis local to the cell site 10 to perform various tasks. The systems andmethods described herein eliminate a need for the engineer/technician toclimb the cell tower 12. Of note, it is still important for theengineer/technician to be local to the cell site 10 as various aspectsof the cell site audit 40 cannot be done remotely as described herein.Furthermore, the systems and methods described herein provide an abilityfor a single engineer/technician to perform the cell site audit 40without another person handling the UAV 50 or a person with a pilot'slicense operating the UAV 50 as described herein.

§ 2.1 Cell Site Audit

In general, the cell site audit 40 is performed to gather informationand identify a state of the cell site 10. This is used to check theinstallation, maintenance, and/or operation of the cell site 10. Variousaspects of the cell site audit 40 can include, without limitation:

Verify the cell site 10 is built according to a current revision VerifyEquipment Labeling Verify Coax Cable (“Coax”) Bend Radius Verify CoaxColor Coding/Tagging Check for Coax External Kinks & Dents Verify CoaxGround Kits Verify Coax Hanger/Support Verify Coax Jumpers Verify CoaxSize Check for Connector Stress & Distortion Check for ConnectorWeatherproofing Verify Correct Duplexers/Diplexers Installed VerifyDuplexer/Diplexer Mounting Verify Duplexers/Diplexers InstalledCorrectly Verify Fiber Paper Verify Lacing & Tie Wraps Check for Looseor Cross-Threaded Coax Connectors Verify Return (“Ret”) Cables VerifyRet Connectors Verify Ret Grounding Verify Ret Installation Verify RetLightning Protection Unit (LPI) Check for Shelter/Cabinet PenetrationsVerify Surge Arrestor Installation/Grounding Verify Site CleanlinessVerify LTE GPS Antenna Installation

Of note, the cell site audit 40 includes gathering information at andinside the shelter or cabinet 52, on the cell tower 12, and at the cellsite components 14. Note, it is not possible to perform all of the aboveitems solely with the UAV 50 or remotely.

§ 3.0 Piloting the UAV at the Cell Site

It is important to note that the Federal Aviation Administration (FAA)is in the process of regulating commercial UAV (drone) operation. It isexpected that these regulations would not be complete until 2016 or2017. In terms of these regulations, commercial operation of the UAV 50,which would include the cell site audit 40, requires at least twopeople, one acting as a spotter and one with a pilot's license. Theseregulations, in the context of the cell site audit 40, would make use ofthe UAV 50 impractical. To that end, the systems and methods describedherein propose operation of the UAV 50 under FAA exemptions which allowthe cell site audit 40 to occur without requiring two people and withoutrequiring a pilot's license. Here, the UAV 50 is constrained to fly upand down at the cell site 10 and within a three-dimensional (3D)rectangle at the cell site components. These limitations on the flightpath of the UAV 50 make the use of the UAV 50 feasible at the cell site10.

FIG. 3 is a screen diagram of a view of a graphical user interface (GUI)60 on a mobile device 100 while piloting the UAV 50. The GUI 60 providesa real-time view to the engineer/technician piloting the UAV 50. Thatis, a screen 62 provides a view from a camera on the UAV 50. As shown inFIG. 3, the cell site 10 is shown with the cell site components 14 inthe view of the screen 62. Also, the GUI 60 has various controls 64, 66.The controls 64 are used to pilot the UAV 50, and the controls 66 areused to perform functions in the cell site audit 40 and the like.

§ 3.1 FAA Regulations

The FAA is overwhelmed with applications from companies interested inflying drones, but the FAA is intent on keeping the skies safe.Currently, approved exemptions for flying drones include tight rules.Once approved, there is some level of certification for drone operatorsalong with specific rules such as speed limit of 100 mph, heightlimitations such as 400 ft, no-fly zones, day only operation,documentation, and restrictions on aerial filming. Accordingly, flightat or around cell towers is constrained, and the systems and methodsdescribed herein fully comply with the relevant restrictions associatedwith drone flights from the FAA.

§ 4.0 Example Hardware

FIG. 4 is a perspective view of an example UAV 50 for use with thesystems and methods described herein. Again, the UAV 50 may be referredto as a drone or the like. The UAV 50 may be a commercially availableUAV platform that has been modified to carry specific electroniccomponents as described herein to implement the various systems andmethods. The UAV 50 includes rotors 80 attached to a body 82. A lowerframe 84 is located on a bottom portion of the body 82, for landing theUAV 50 to rest on a flat surface and absorb impact during landing. TheUAV 50 also includes a camera 86 which is used to take stillphotographs, video, and the like. Specifically, the camera 86 is used toprovide the real-time display on the screen 62. The UAV 50 includesvarious electronic components inside the body 82 and/or the camera 86such as, without limitation, a processor, a data store, memory, awireless interface, and the like. Also, the UAV 50 can includeadditional hardware, such as robotic arms or the like that allow the UAV50 to attach/detach components for the cell site components 14.Specifically, it is expected that the UAV 50 will get bigger and moreadvanced, capable of carrying significant loads, and not just a wirelesscamera. The present disclosure contemplates using the UAV 50 for variousaspects at the cell site 10, including participating in construction ordeconstruction of the cell tower 12, the cell site components 14, etc.

These various components are now described with reference to a mobiledevice 100. Those of ordinary skill in the art will recognize the UAV 50can include similar components to the mobile device 100. Of note, theUAV 50 and the mobile device 100 can be used cooperatively to performvarious aspects of the cell site audit 40 described herein. In otherembodiments, the UAV 50 can be operated with a controller instead of themobile device 100. The mobile device 100 may solely be used forreal-time video from the camera 86 such as via a wireless connection(e.g., IEEE 802.11 or variants thereof). Some portions of the cell siteaudit 40 can be performed with the UAV 50, some with the mobile device100, and others solely by the operator through a visual inspection. Insome embodiments, all of the aspects can be performed in the UAV 50. Inother embodiments, the UAV 50 solely relays data to the mobile device100 which performs all of the aspects. Other embodiments are alsocontemplated.

FIG. 5 is a block diagram of a mobile device 100, which may be used forthe cell site audit 40 or the like. The mobile device 100 can be adigital device that, in terms of hardware architecture, generallyincludes a processor 102, input/output (I/O) interfaces 104, wirelessinterfaces 106, a data store 108, and memory 110. It should beappreciated by those of ordinary skill in the art that FIG. 5 depictsthe mobile device 100 in an oversimplified manner, and a practicalembodiment may include additional components and suitably configuredprocessing logic to support known or conventional operating featuresthat are not described in detail herein. The components (102, 104, 106,108, and 102) are communicatively coupled via a local interface 112. Thelocal interface 112 can be, for example, but not limited to, one or morebuses or other wired or wireless connections, as is known in the art.The local interface 112 can have additional elements, which are omittedfor simplicity, such as controllers, buffers (caches), drivers,repeaters, and receivers, among many others, to enable communications.Further, the local interface 112 may include address, control, and/ordata connections to enable appropriate communications among theaforementioned components.

The processor 102 is a hardware device for executing softwareinstructions. The processor 102 can be any custom made or commerciallyavailable processor, a central processing unit (CPU), an auxiliaryprocessor among several processors associated with the mobile device100, a semiconductor-based microprocessor (in the form of a microchip orchip set), or generally any device for executing software instructions.When the mobile device 100 is in operation, the processor 102 isconfigured to execute software stored within the memory 110, tocommunicate data to and from the memory 110, and to generally controloperations of the mobile device 100 pursuant to the softwareinstructions. In an embodiment, the processor 102 may include amobile-optimized processor such as optimized for power consumption andmobile applications. The I/O interfaces 104 can be used to receive userinput from and/or for providing system output. User input can beprovided via, for example, a keypad, a touch screen, a scroll ball, ascroll bar, buttons, barcode scanner, and the like. System output can beprovided via a display device such as a liquid crystal display (LCD),touch screen, and the like. The I/O interfaces 104 can also include, forexample, a serial port, a parallel port, a small computer systeminterface (SCSI), an infrared (IR) interface, a radio frequency (RF)interface, a universal serial bus (USB) interface, and the like. The I/Ointerfaces 104 can include a graphical user interface (GUI) that enablesa user to interact with the mobile device 100. Additionally, the I/Ointerfaces 104 may further include an imaging device, i.e., camera,video camera, etc.

The wireless interfaces 106 enable wireless communication to an externalaccess device or network. Any number of suitable wireless datacommunication protocols, techniques, or methodologies can be supportedby the wireless interfaces 106, including, without limitation: RF; IrDA(infrared); Bluetooth; ZigBee (and other variants of the IEEE 802.15protocol); IEEE 802.11 (any variation); IEEE 802.16 (WiMAX or any othervariation); Direct Sequence Spread Spectrum; Frequency Hopping SpreadSpectrum; Long Term Evolution (LTE); cellular/wireless/cordlesstelecommunication protocols (e.g. 3G/4G, etc.); wireless home networkcommunication protocols; paging network protocols; magnetic induction;satellite data communication protocols; wireless hospital or health carefacility network protocols such as those operating in the WMTS bands;GPRS; proprietary wireless data communication protocols such as variantsof Wireless USB; and any other protocols for wireless communication. Thewireless interfaces 106 can be used to communicate with the UAV 50 forcommand and control as well as to relay data therebetween. The datastore 108 may be used to store data. The data store 108 may include anyof volatile memory elements (e.g., random access memory (RAM, such asDRAM, SRAM, SDRAM, and the like)), nonvolatile memory elements (e.g.,ROM, hard drive, tape, CDROM, and the like), and combinations thereof.Moreover, the data store 108 may incorporate electronic, magnetic,optical, and/or other types of storage media.

The memory 110 may include any of volatile memory elements (e.g., randomaccess memory (RAM, such as DRAM, SRAM, SDRAM, etc.)), nonvolatilememory elements (e.g., ROM, hard drive, etc.), and combinations thereof.Moreover, the memory 110 may incorporate electronic, magnetic, optical,and/or other types of storage media. Note that the memory 110 may have adistributed architecture, where various components are situated remotelyfrom one another but can be accessed by the processor 102. The softwarein memory 110 can include one or more software programs, each of whichincludes an ordered listing of executable instructions for implementinglogical functions. In the example of FIG. 5, the software in the memory110 includes a suitable operating system (O/S) 114 and programs 116. Theoperating system 114 essentially controls the execution of othercomputer programs and provides scheduling, input-output control, fileand data management, memory management, and communication control andrelated services. The programs 116 may include various applications,add-ons, etc. configured to provide end-user functionality with themobile device 100, including performing various aspects of the systemsand methods described herein.

It will be appreciated that some embodiments described herein mayinclude one or more generic or specialized processors (“one or moreprocessors”) such as microprocessors, digital signal processors,customized processors, and field programmable gate arrays (FPGAs) andunique stored program instructions (including both software andfirmware) that control the one or more processors to implement, inconjunction with certain non-processor circuits, some, most, or all ofthe functions of the methods and/or systems described herein.Alternatively, some or all functions may be implemented by a statemachine that has no stored program instructions, or in one or moreapplication specific integrated circuits (ASICs), in which each functionor some combinations of certain of the functions are implemented ascustom logic. Of course, a combination of the aforementioned approachesmay be used. Moreover, some embodiments may be implemented as anon-transitory computer-readable storage medium having computer readablecode stored thereon for programming a computer, server, appliance,device, etc. each of which may include a processor to perform methods asdescribed and claimed herein. Examples of such computer-readable storagemediums include, but are not limited to, a hard disk, an optical storagedevice, a magnetic storage device, a ROM (Read Only Memory), a PROM(Programmable Read Only Memory), an EPROM (Erasable Programmable ReadOnly Memory), an EEPROM (Electrically Erasable Programmable Read OnlyMemory), Flash memory, and the like. When stored in the non-transitorycomputer-readable medium, the software can include instructionsexecutable by a processor that, in response to such execution, cause aprocessor or any other circuitry to perform a set of operations, steps,methods, processes, algorithms, etc.

§ 4.1 RF Sensors in the UAV

In an embodiment, the UAV 50 can also include one or more RF sensorsdisposed therein. The RF sensors can be any device capable of makingwireless measurements related to signals associated with the cell sitecomponents 14, i.e., the antennas. In an embodiment, the UAV 50 can befurther configured to fly around a cell zone associated with the cellsite 10 to identify wireless coverage through various measurementsassociated with the RF sensors.

§ Cell Site Audit with UAV and/or Mobile Device

FIG. 6 is a flowchart of a cell site audit method 200 utilizing the UAV50 and the mobile device 100. Again, in various embodiments, the cellsite audit 40 can be performed with the UAV 50 and the mobile device100. In other embodiments, the cell site audit 40 can be performed withthe UAV 50 and an associated controller. In other embodiments, themobile device 100 is solely used to relay real-time video from thecamera 86. While the steps of the cell site audit method 200 are listedsequentially, those of ordinary skill in the art will recognize some orall of the steps may be performed in a different order. The cell siteaudit method 200 includes an engineer/technician at a cell site with theUAV 50 and the mobile device 100 (step 202). Again, one aspect of thesystems and methods described herein is the usage of the UAV 50, in acommercial setting, but with constraints such that only one operator isrequired and such that the operator does not have to hold a pilot'slicense. As described herein, the constraints can include a flight ofthe UAV 50 at or near the cell site 10 only, a flight pattern up anddown in a 3D rectangle at the cell tower 12, a maximum heightrestriction (e.g., 500 feet or the like), and the like. For example, thecell site audit 40 is performed by one of i) a single operator flyingthe UAV 50 without a license or ii) two operators including one with alicense and one to spot the UAV 50.

The engineer/technician performs one or more aspects of the cell siteaudit 40 without the UAV 50 (step 204). Note, there are many aspects ofthe cell site audit 40 as described herein. It is not possible for theUAV 50 to perform all of these items such that the engineer/techniciancould be remote from the cell site 10. For example, access to theshelter or cabinet 52 for audit purposes requires theengineer/technician to be local. In this step, the engineer/techniciancan perform any audit functions as described herein that do not requireclimbing.

The engineer/technician can cause the UAV 50 to fly up the cell tower 12or the like to view cell site components 14 (step 206). Again, thisflight can be based on the constraints, and the flight can be through acontroller and/or the mobile device 100. The UAV 50 and/or the mobiledevice 100 can collect data associated with the cell site components 14(step 208) and process the collected data to obtain information for thecell site audit 40 (step 210). As described herein, the UAV 50 and themobile device 100 can be configured to collect data via video and/orphotographs. The engineer/technician can use this collected data toperform various aspects of the cell site audit 40 with the UAV 50 andthe mobile device 100 and without a tower climb.

The foregoing descriptions detail specific aspects of the cell siteaudit 40 using the UAV 50 and the mobile device 100. In these aspects,data can be collected—generally, the data is video or photographs of thecell site components 14. The processing of the data can be automatedthrough the UAV 50 and/or the mobile device 100 to compute certain itemsas described herein. Also, the processing of the data can be performedeither at the cell site 10 or afterward by the engineer/technician.

In an embodiment, the UAV 50 can be a commercial, “off-the-shelf” dronewith a Wi-Fi enabled camera for the camera 86. Here, the UAV 50 is flownwith a controller pad which can include a joystick or the like.Alternatively, the UAV 50 can be flown with the mobile device 100, suchas with an app installed on the mobile device 100 configured to controlthe UAV 50. The Wi-Fi enabled camera is configured to communicate withthe mobile device 100—to both display real-time video and audio as wellas to capture photos and/or video during the cell site audit 40 forimmediate processing or for later processing to gather relevantinformation about the cell site components 14 for the cell site audit40.

In another embodiment, the UAV 50 can be a so-called “drone in a box”which is preprogrammed/configured to fly a certain route, such as basedon the flight constraints described herein. The “drone in a box” can bephysically transported to the cell site 10 or actually located there.The “drone in a box” can be remotely controlled as well.

§ 5.1 Antenna Down Tilt Angle

In an aspect of the cell site audit 40, the UAV 50 and/or the mobiledevice 100 can be used to determine a down tilt angle of individualantennas 30 of the cell site components 14. The down-tilt angle can bedetermined for all of the antennas 30 in all of the sectors 54, 56, 58.The down-tilt angle is the mechanical (external) down tilt of theantennas 30 relative to a support bar 200. In the cell site audit 40,the down-tilt angle is compared against an expected value, such as froma Radio Frequency (RF) data sheet, and the comparison may check toensure the mechanical (external) down tilt is within ±1.0° ofspecification on the RF data sheet.

Using the UAV 50 and/or the mobile device 100, the down-tilt angle isdetermined from a photo taken from the camera 86. In an embodiment, theUAV 50 and/or the mobile device 100 is configured to measure threepoints—two defined by the antenna 30 and one by the support bar 200 todetermine the down tilt angle of the antenna 30. For example, thedown-tilt angle can be determined visually from the side of the antenna30—measuring a triangle formed by a top of the antenna 30, a bottom ofthe antenna 30, and the support bar 200.

§ 5.2 Antenna Plumb

In an aspect of the cell site audit 40 and similar to determining thedown tilt angle, the UAV 50 and/or the mobile device 100 can be used tovisually inspect the antenna 30 including its mounting brackets andassociated hardware. This can be done to verify appropriate hardwareinstallation, to verify the hardware is not loose or missing, and toverify that antenna 30 is plumb relative to the support bar 200.

§ 5.3 Antenna Azimuth

In an aspect of the cell site audit 40, the UAV 50 and/or the mobiledevice 100 can be used to verify the antenna azimuth, such as verifyingthe antenna azimuth is oriented within ±5° as defined on the RF datasheet. The azimuth (AZ) angle is the compass bearing, relative to true(geographic) north, of a point on the horizon directly beneath anobserved object. Here, the UAV 50 and/or the mobile device 100 caninclude a location determining device such as a Global PositioningSatellite (GPS) measurement device. The antenna azimuth can bedetermined with the UAV 50 and/or the mobile device 100 using an aerialphoto or the GPS measurement device.

§ 5.4 Photo Collections

As part of the cell site audit 40 generally, the UAV 50 and/or themobile device 100 can be used to document various aspects of the cellsite 10 by taking photos or video. For example, the mobile device 100can be used to take photos or video on the ground in or around theshelter or cabinet 52 and the UAV 500 can be used to take photos orvideo up the cell tower 12 and of the cell site components 14. Thephotos and video can be stored in any of the UAV 50, the mobile device100, the cloud, etc.

In an embodiment, the UAV can also hover at the cell site 10 and providereal-time video footage back to the mobile device 100 or anotherlocation (for example, a Network Operations Center (NOC) or the like).

§ 5.5 Compound Length/Width

The UAV 50 can be used to fly over the cell site 10 to measure theoverall length and width of the cell site 10 compound from overheadphotos. In one aspect, the UAV 50 can use GPS positioning to detect thelength and width by flying over the cell site 10. In another aspect, theUAV 50 can take overhead photos which can be processed to determine theassociated length and width of the cell site 10.

§ Data Capture—Cell Site Audit

The UAV 50 can be used to capture various pieces of data via the camera86. That is, with the UAV 50 and the mobile device 100, the camera 86 isequivalent to the engineer/technician's own eyes, thereby eliminatingthe need for the engineer/technician to physically climb the tower. Oneimportant aspect of the cell site audit 40 is physically collectingvarious pieces of information—either to check records for consistency orto establish a record. For example, the data capture can includedetermining equipment module types, locations, connectivity, serialnumbers, etc. from photos. The data capture can include determiningphysical dimensions from photos or from GPS such as the cell tower 12height, width, depth, etc. The data capture can also include visualinspection of any aspect of the cell site 10, cell tower 12, cell sitecomponents 14, etc. including, but not limited to, physicalcharacteristics, mechanical connectivity, cable connectivity, and thelike.

The data capture can also include checking the lighting rod 16 and thewarning light 18 on the cell tower 12. Also, with additional equipmenton the UAV 50, the UAV 50 can be configured to perform maintenance suchas replacing the warning light 18, etc. The data capture can alsoinclude checking maintenance status of the cell site components 14visually as well as checking associated connection status. Anotheraspect of the cell site audit 40 can include checking the structuralintegrity of the cell tower 12 and the cell site components 14 viaphotos from the UAV 50.

§ 5.7 Flying the UAV at the Cell Site

In an embodiment, the UAV 50 can be programmed to automatically fly to alocation and remain there without requiring the operator to control theUAV 50 in real-time, at the cell site 10. In this scenario, the UAV 50can be stationary at a location in the air at the cell site 10. Here,various functionality can be incorporated in the UAV 50 as describedherein. Note, this aspect leverages the ability to fly the UAV 50commercially based on the constraints described herein. That is, the UAV50 can be used to fly around the cell tower 12, to gather dataassociated with the cell site components 14 for the various sectors 54,56, 58. Also, the UAV 50 can be used to hover around the cell tower 12,to provide additional functionality described as follows.

§ 5.8 Video/Photo Capture—Cell Site

With the UAV 50 available to operate at the cell site 10, the UAV 50 canalso be used to capture video/photos while hovering. This applicationuses the UAV 50 as a mobile video camera to capture activity at oraround the cell site 10 from the air. It can be used to document work atthe cell site 10 or to investigate the cell site 10 responsive toproblems, e.g., tower collapse. It can be used to take surveillancevideo of surrounding locations such as service roads leading to the cellsite 10, etc.

§ 5.9 Wireless Service Via the UAV

Again, with the ability to fly at the cell site 10, subject to theconstraints, the UAV 50 can be used to provide temporary or evenpermanent wireless service at the cell site. This is performed with theaddition of wireless service-related components to the UAV 50. In thetemporary mode, the UAV 50 can be used to provide services over a shorttime period, such as responding to an outage or other disaster affectingthe cell site 10. Here, an operator can cause the UAV 50 to fly wherethe cell site components 14 are and provide such service. The UAV 50 canbe equipped with wireless antennas to provide cell service, WirelessLocal Area Network (WLAN) service, or the like. The UAV 50 caneffectively operate as a temporary tower or small cell as needed.

In the permanent mode, the UAV 50 (along with other UAVs 50) canconstantly be in the air at the cell site 10 providing wireless service.This can be done similar to the temporary mode but over a longer timeperiod. The UAV 50 can be replaced over a predetermined time to refuelor the like. The replacement can be another UAV 50. The UAV 50 caneffectively operate as a permanent tower or small cell as needed.

§ 6.0 Flying the UAV from Cell Site to Another Cell Site

As described herein, the flight constraints include operating the UAV 50vertically in a defined 3D rectangle at the cell site 10. In anotherembodiment, the flight constraints can be expanded to allow the 3Drectangle at the cell site 10 as well as a horizontal operation betweenadjacent cell sites 10. FIG. 7 is a network diagram of various cellsites 10 a-10 e deployed in a geographic region 300. In an embodiment,the UAV 50 is configured to operate as described herein, such as in FIG.2, in the vertical 3D rectangular flight pattern, as well as in ahorizontal flight pattern between adjacent cell sites 10. Here, the UAV50 is cleared to fly, without the commercial regulations, between theadjacent cell sites 10.

In this manner, the UAV 50 can be used to perform the cell site audits40 at multiple locations—note, the UAV 50 does not need to land andphysically be transported to the adjacent cell sites 10. Additionally,the fact that the FAA will allow exemptions to fly the UAV 50 at thecell site 10 and between adjacent cell sites 10 can create aninterconnected mesh network of allowable flight paths for the UAV 50.Here, the UAV 50 can be used for other purposes besides those related tothe cell site 10. That is, the UAV 50 can be flown in any application,independent of the cell sites 10, but without requiring FAA regulation.The applications can include, without limitation, a drone deliverynetwork, a drone surveillance network, and the like.

As shown in FIG. 7, the UAV 50, at the cell site 10 a, can be flown toany of the other cell sites 10 b-10 e along flight paths 302. Due to thefact that cell sites 10 are numerous and diversely deployed in thegeographic region 300, an ability to fly the UAV 50 at the cell sites 10and between adjacent cell sites 10 creates an opportunity to fly the UAV50 across the geographic region 300, for numerous applications.

§ 7.0 UAV and Cell Towers

Additionally, the systems and methods described herein contemplatepractically any activity at the cell site 10 using the UAV 50 in lieu ofa tower climb. This can include, without limitation, any tower auditwork with the UAV 50, any tower warranty work with the UAV 50, any toweroperational ready work with the UAV 50, any tower construction with theUAV 50, any tower decommissioning/deconstruction with the UAV 50, anytower modifications with the UAV 50, and the like.

§ 8.0 Cell Site Operations

There are generally two entities associated with cell sites—cell siteowners and cell site operators. Generally, cell site owners can beviewed as real estate property owners and managers. Typical cell siteowners may have a vast number of cell sites, such as tens of thousands,geographically dispersed. The cell site owners are generally responsiblefor the real estate, ingress and egress, structures on site, the celltower itself, etc. Cell site operators generally include wirelessservice providers who generally lease space on the cell tower and in thestructures for antennas and associated wireless backhaul equipment.There are other entities that may be associated with cell sites as wellincluding engineering firms, installation contractors, and the like. Allof these entities have a need for the various UAV-based systems andmethods described herein. Specifically, cell site owners can use thesystems and methods for real estate management functions, auditfunctions, etc. Cell site operators can use the systems and methods forequipment audits, troubleshooting, site engineering, etc. Of course, thesystems and methods described herein can be provided by an engineeringfirm or the like contracted to any of the above entities or the like.The systems and methods described herein provide these entities timesavings, increased safety, better accuracy, lower cost, and the like.

§ 10.0 3D Modeling Systems and Methods with UAVs

FIG. 8 is a diagram of the cell site 10 and an associated launchconfiguration and flight for the UAV 50 to obtain photos for a 3D modelof the cell site 10. Again, the cell site 10, the cell tower 12, thecell site components 14, etc. are as described herein. To develop a 3Dmodel, the UAV 50 is configured to take various photos during flight, atdifferent angles, orientations, heights, etc. to develop a 360-degreeview. For post-processing, it is important to differentiate betweendifferent photos accurately. In various embodiments, the systems andmethods utilize accurate location tracking for each photo taken. It isimportant for accurate correlation between photos to enable constructionof a 3D model from a plurality of 2D photos. The photos can all includemultiple location identifiers (i.e., where the photo was taken from,height and exact location). In an embodiment, the photos can eachinclude at least two distinct location identifiers, such as from GPS orGLONASS. GLONASS is a “GLObal NAvigation Satellite System” which is aspace-based satellite navigation system operating in the radionavigation-satellite service and used by the Russian Aerospace DefenceForces. It provides an alternative to GPS and is the second alternativenavigational system in operation with global coverage and of comparableprecision. The location identifiers are tagged or embedded in each photoand indicative of the location of the UAV 50 where and when the photowas taken. These location identifiers are used with objects of interestidentified in the photo during post-processing to create the 3D model.

In fact, it was determined that location identifier accuracy is veryimportant in the post-processing for creating the 3D model. One suchdetermination was that there are slight inaccuracies in the locationidentifiers when the UAV 50 is launched from a different location and/ororientation. Thus, to provide further accuracy for the locationidentifiers, each flight of the UAV 50 is constrained to land and departfrom a same location and orientation. For example, future flights of thesame cell site 10 or additional flights at the same time when the UAV 50lands and, e.g., has a battery change. To ensure the same locationand/or orientation in subsequent flights at the cell site 10, a zoneindicator 800 is set at the cell site 10, such as on the ground via somemarking (e.g., chalk, rope, white powder, etc.). Each flight at the cellsite 10 for purposes of obtaining photos for 3D modeling is done usingthe zone indicator 800 to land and launch the UAV 50. Based onoperations, it was determined that using conventional UAVs 50; the zoneindicator 800 provides significantly more accuracy in locationidentifier readings. Accordingly, the photos are accurately identifiedrelative to one another and able to create an extremely accurate 3Dmodel of all physical features of the cell site 10. Thus, in anembodiment, all UAV 50 flights are from the same launch point andorientation to avoid calibration issues with any location identifiertechnique. The zone indicator 800 can also be marked on the 3D model forfuture flights at the cell site 10. Thus, the use of the zone indicator800 for the same launch location and orientation along with the multiplelocation indicators provide more precision in the coordinates for theUAV 50 to correlate the photos.

Note, in other embodiments, the zone indicator 800 may be omitted, orthe UAV 50 can launch from additional points, such that the data usedfor the 3D model is only based on a single flight. The zone indicator800 is advantageous when data is collected over time or when there arelandings in flight.

Once the zone indicator 800 is established, the UAV 50 is placed thereinin a specific orientation (orientation is arbitrary so long as the sameorientation is continually maintained). The orientation refers to whichway the UAV 50 is facing at launch and landing. Once the UAV 50 is inthe zone indicator 800, the UAV 50 can be flown up (denoted by line 802)the cell tower 12. Note, the UAV 50 can use the aforementioned flightconstraints to conform to FAA regulations or exemptions. Once at acertain height and certain distance from the cell tower 12 and the cellsite components 14, the UAV 50 can take a circular or 360-degree flightpattern about the cell tower 12, including flying up as well as aroundthe cell tower 12 (denoted by line 804).

During the flight, the UAV 50 is configured to take various photos ofdifferent aspects of the cell site 10 including the cell tower 12, thecell site components 14, as well as surrounding area. These photos areeach tagged or embedded with multiple location identifiers. It has alsobeen determined that the UAV 50 should be flown at a certain distancebased on its camera capabilities to obtain the optimal photos, i.e., nottoo close or too far from objects of interest. The UAV 50 in a givenflight can take hundreds or even thousands of photos, each with theappropriate location identifiers. For an accurate 3D model, at leasthundreds of photos are required. The UAV 50 can be configured to takepictures automatically are given intervals during the flight, and theflight can be a preprogrammed trajectory around the cell site 10.Alternatively, the photos can be manually taken based on operatorcommands. Of course, a combination is also contemplated. In anotherembodiment, the UAV 50 can include preprocessing capabilities whichmonitor photos taken to determine a threshold after which enough photoshave been taken to construct the 3D model accurately.

FIG. 9 is a satellite view of an example flight of the UAV 50 at thecell site 10. Note, photos are taken at locations marked with circles inthe satellite view. Note, the flight of the UAV 50 can be solely toconstruct the 3D model, or as part of the cell site audit 40 describedherein. Also note, the example flight allows photos at differentlocations, angles, orientations, etc. such that the 3D model not onlyincludes the cell tower 12, but also the surrounding geography.

FIG. 10 is a side view of an example flight of the UAV 50 at the cellsite 10. Similar to FIG. 9, FIG. 10 shows circles in the side view atlocations where photos were taken. Note, photos are taken at differentelevations, orientations, angles, and locations. The photos are storedlocally in the UAV 50 and/or transmitted wirelessly to a mobile device,controller, server, etc. Once the flight is complete, and the photos areprovided to an external device from the UAV 50 (e.g., mobile device,controller, server, cloud service, or the like), post-processing occursto combine the photos or “stitch” them together to construct the 3Dmodel. While described separately, the post-processing could occur inthe UAV 50 provided its computing power is capable.

FIG. 11 is a logical diagram of a portion of a cell tower 12 along withassociated photos taken by the UAV 50 at different points relativethereto. Specifically, various 2D photos are logically shown atdifferent locations relative to the cell tower 12 to illustrate thelocation identifiers and the stitching together of the photos.

FIG. 12 is a screen shot of a Graphic User Interface (GUI) associatedwith post-processing photos from the UAV 50. Again, once the UAV 50 hascompleted taking photos of the cell site 10, the photos arepost-processed to form a 3D model. The systems and methods contemplateany software program capable of performing photogrammetry. In theexample of FIG. 12, there are 128 total photos. The post-processingincludes identifying visible points across the multiple points, i.e.,objects of interest. For example, the objects of interest can be any ofthe cell site components 14, such as antennas. The post-processingidentifies the same object of interest across different photos, withtheir corresponding location identifiers, and builds a 3D model based onmultiple 2D photos.

FIG. 13 is a screen shot of a 3D model constructed from a plurality of2D photos taken from the UAV 50 as described herein. Note, the 3D modelcan be displayed on a computer or another type of processing device,such as via an application, a Web browser, or the like. The 3D modelsupports zoom, pan, tilt, etc.

FIGS. 14-19 are various screenshots of GUIs associated with a 3D modelof a cell site based on photos taken from the UAV 50 as describedherein. FIG. 14 is a GUI illustrating an example measurement of anobject, i.e., the cell tower 12, in the 3D model. Specifically, using apoint and click operation, one can click on two points such as the topand bottom of the cell tower and the 3D model can provide a measurement,e.g., 175′ in this example. FIG. 15 illustrates a close-up view of acell site component 14 such as an antenna and a similar measurement madethereon using point and click, e.g., 4.55′ in this example. FIGS. 16 and17 illustrate an aerial view of the 3D model showing surroundinggeography around the cell site 10. From these views, the cell tower 12is illustrated with the surrounding environment including thestructures, access road, fall line, etc. Specifically, the 3D model canassist in determining a fall line which is anywhere in the surroundingsof the cell site 10 where the cell tower 12 may fall. Appropriateconsiderations can be made based thereon.

FIGS. 18 and 19 illustrate the 3D model and associated photos on theright side. One useful aspect of the 3D model GUI is an ability to clickanywhere on the 3D model and bring up corresponding 2D photos. Here, anoperator can click anywhere and bring up full-sized photos of the area.Thus, with the systems and methods described herein, the 3D model canmeasure and map the cell site 10 and surrounding geography along withthe cell tower 12, the cell site components 14, etc. to form acomprehensive 3D model. There are various uses of the 3D model toperform cell site audits including checking tower grounding; sizing andplacement of antennas, piping, and other cell site components 14;providing engineering drawings; determining characteristics such asantenna azimuths; and the like.

FIG. 20 is a photo of the UAV 50 in flight at the top of a cell tower12. As described herein, it was determined that the optimum distance tophotograph the cell site components 14 is about 10′ to 40′ distance.

FIG. 21 is a flowchart of a method 850 for modeling a cell site with aUAV. The method 850 includes causing the UAV to fly a given flight pathabout a cell tower at the cell site, wherein a launch location andlaunch orientation is defined for the UAV to take off and land at thecell site such that each flight at the cell site has the same launchlocation and launch orientation (step 852); obtaining a plurality ofphotographs of the cell site during about the flight plane, wherein eachof the plurality of photographs is associated with one or more locationidentifiers (step 854); and, subsequent to the obtaining, processing theplurality of photographs to define a 3D model of the cell site based onthe associated with one or more location identifiers and one or moreobjects of interest in the plurality of photographs (step 856).

The method 850 can further include landing the UAV at the launchlocation in the launch orientation; performing one or more operations onthe UAV, such as changing a battery; and relaunching the UAV from thelaunch location in the launch orientation to obtain additionalphotographs. The one or more location identifiers can include at leasttwo location identifiers including GPS and GLONASS. The flight plan canbe constrained to an optimum distance from the cell tower. The pluralityof photographs can be obtained automatically during the flight planwhile concurrently performing a cell site audit of the cell site. Themethod 850 can further include providing a GUI of the 3D model; andusing the GUI to perform a cell site audit. The method 850 can furtherinclude providing a GUI of the 3D model; and using the GUI to measurevarious components at the cell site. The method 850 can further includeproviding a GUI of the 3D model; and using the GUI to obtain photographsof the various components at the cell site.

§ 11.1 3D Modeling Systems and Methods without UAVs

The above description explains 3D modeling and photo data capture usingthe UAV 50. Additionally, the photo data capture can be through othermeans, including portable cameras, fixed cameras, heads-up displays(HUD), head-mounted cameras, and the like. That is the systems andmethods described herein contemplate the data capture through anyavailable technique. The UAV 50 will be difficult to obtain photosinside the buildings, i.e., the shelter or cabinet 52. FIG. 22 is adiagram of an example interior 900 of a building 902, such as theshelter or cabinet 52, at the cell site 10. Generally, the building 902houses equipment associated with the cell site 10 such as wireless RFterminals 910 (e.g., LTE terminals), wireless backhaul equipment 912,power distribution 914, and the like. Generally, wireless RF terminals910 connect to the cell site components 14 for providing associatedwireless service. The wireless backhaul equipment 912 includesnetworking equipment to bring the associated wireless service signals toa wireline network, such as via fiber optics or the like. The powerdistribution 914 provides power for all of the equipment such as fromthe grid as well as a battery backup to enable operation in the event ofpower failures. Of course, additional equipment and functionality arecontemplated in the interior 900.

The terminals 910, equipment 912, and the power distribution 914 can berealized as rack or frame mounted hardware with cabling 916 and withassociated modules 918. The modules 918 can be pluggable modules whichare selectively inserted in the hardware and each can include uniqueidentifiers 920 such as barcodes, Quick Response (QR) codes, RFIdentification (RFID), physical labeling, color coding, or the like.Each module 918 can be unique with a serial number, part number, and/orfunctional identifier. The modules 918 are configured as needed toprovide the associated functionality of the cell site.

The systems and methods include, in addition to the aforementioned photocapture via the UAV 50, photo data capture in the interior 900 for 3Dmodeling and for virtual site surveys. The photo data capture can beperformed by a fixed, rotatable camera 930 located in the interior 900.The camera 930 can be communicatively coupled to a Data CommunicationNetwork (DCN), such as through the wireless backhaul equipment 912 orthe like. The camera 930 can be remotely controlled, such as by anengineer performing a site survey from his or her office. Othertechniques of photo data capture can include an on-site techniciantaking photos with a camera and uploading them to a cloud service or thelike. Again, the systems and methods contemplate any type of datacapture.

Again, with a plurality of photos, e.g., hundreds, it is possible toutilize photogrammetry to create a 3D model of the interior 900 (as wellas a 3D model of the exterior as described above). The 3D model iscreated using physical cues in the photos to identify objects ofinterest, such as the modules 918, the unique identifiers 920, or thelike. Note, the location identifiers described relative to the UAV 50are less effective in the interior 900 given the enclosed, interiorspace and the closer distances.

§ 12.0 Virtual Site Survey

FIG. 23 is a flowchart of a virtual site survey method 950 for the cellsite 10. The virtual site survey method 950 is associated with the cellsite 10 and utilizes three-dimensional (3D) models for remoteperformance, i.e., at an office as opposed to in the field. The virtualsite survey method 950 includes obtaining a plurality of photographs ofa cell site including a cell tower and one or more buildings andinteriors thereof (step 952); subsequent to the obtaining, processingthe plurality of photographs to define a three dimensional (3D) model ofthe cell site based on one or more objects of interest in the pluralityof photographs (step 954); and remotely performing a site survey of thecell site utilizing a Graphical User Interface (GUI) of the 3D model tocollect and obtain information about the cell site, the cell tower, theone or more buildings, and the interiors thereof (step 956). The 3Dmodel is a combination of an exterior of the cell site including thecell tower and associated cell site components thereon, geography localto the cell site, and the interiors of the one or more buildings at thecell site, and the 3D model can include detail at a module level in theinteriors.

The remotely performing the site survey can include determiningequipment location on the cell tower and in the interiors; measuringdistances between the equipment and within the equipment to determineactual spatial location; and determining connectivity between theequipment based on associated cabling. The remotely performing the sitesurvey can include planning for one or more of new equipment and changesto existing equipment at the cell site through drag and drop operationsin the GUI, wherein the GUI includes a library of equipment for the dragand drop operations; and, subsequent to the planning, providing a listof the one or more of the new equipment and the changes to the existingequipment based on the library, for implementation thereof. The remotelyperforming the site survey can include providing one or more of thephotographs of an associated area of the 3D model responsive to anoperation in the GUI. The virtual site survey method 950 can includerendering a texture map of the interiors responsive to an operation inthe GUI.

The virtual site survey method 950 can include performing an inventoryof equipment at the cell site including cell site components on the celltower and networking equipment in the interiors, wherein the inventoryfrom the 3D model uniquely identifies each of the equipment based onassociated unique identifiers. The remotely performing the site surveycan include providing equipment visual in the GUI of a rack and allassociated modules therein. The obtaining can include the UAV 50obtaining the photographs on the cell tower, and the obtaining includesone or more of a fixed and portable camera obtaining the photographs inthe interior. The obtaining can be performed by an on-site technician atthe cell site, and the site survey can be remotely performed.Additionally, an apparatus can be adapted to perform a virtual sitesurvey of a cell site.

The virtual site survey can perform anything remotely that traditionallywould have required on-site presence, including the various aspects ofthe cell site audit 40 described herein. The GUI of the 3D model can beused to check plumbing of coaxial cabling, connectivity of all cabling,automatic identification of cabling endpoints such as through uniqueidentifiers detected on the cabling, and the like. The GUI can furtherbe used to check power plant and batteries, power panels, physicalhardware, grounding, heating and air conditioning, generators, safetyequipment, and the like.

The 3D model can be utilized to automatically provide engineeringdrawings, such as responsive to the planning for new equipment orchanges to existing equipment. Here, the GUI can have a library ofequipment (e.g., approved equipment and vendor information can beperiodically imported into the GUI). Normal drag and drop operations inthe GUI can be used for equipment placement from the library. Also, theGUI system can include error checking, e.g., a particular piece ofequipment is incompatible with placement or in violation of policies,and the like.

§ 13.0 Close-Out Audit Systems and Methods

Again, a close-out audit is done to document and verify the workperformed at the cell site 10. The systems and methods eliminate theseparate third-party inspection firm for the close-out audit. Thesystems and methods include the installers (i.e., from the third-partyinstallation firm, the owner, the operator, etc.) performing videocapture subsequent to the installation and maintenance and using varioustechniques to obtain data from the video capture for the close-outaudit. The close-out audit can be performed off-site with the data fromthe video capture thereby eliminating unnecessary tower climbs, sitevisits, and the like.

FIG. 24 is a flowchart of a close-out audit method 1350 performed at acell site subsequent to maintenance or installation work. The close-outaudit method 1350 includes, subsequent to the maintenance orinstallation work, obtaining video capture of cell site componentsassociated with the work (step 1352); subsequent to the video capture,processing the video capture to obtain data for the close-out audit,wherein the processing comprises identifying the cell site componentsassociated with the work (step 1354); and creating a close-out auditpackage based on the processed video capture, wherein the close-outaudit package provides verification of the maintenance or installationwork and outlines that the maintenance or installation work wasperformed in a manner consistent with an operator or owner's guidelines(step 1356).

The video capture can be performed by a mobile device and one or more oflocally stored thereon and transmitted from the mobile device. The videocapture can also be performed by a mobile device which wirelesslytransmits a live video feed, and the video capture is remotely storedfrom the cell site. The video capture can also be performed by a UAVflown at the cell site. Further, the video capture can be a live videofeed with two-way communication between an installer associated with themaintenance or installation work and personnel associated with theoperator or owner to verify the maintenance or installation work. Forexample, the installer and the personnel can communicate to go throughvarious items in the maintenance or installation work to check/audit thework.

The close-out audit method 1350 can also include creating a 3D modelfrom the video capture; determining equipment location from the 3Dmodel; measuring distances between the equipment and within theequipment to determine actual spatial location; and determiningconnectivity between the equipment based on associated cabling from the3D model. The close-out audit method 1350 can also include uniquelyidentifying the cell site components from the video capture anddistinguishing in the close-out audit package. The close-out auditmethod 1350 can also include determining antenna height, azimuth, anddown tilt angles for antennas in the cell site components from the videocapture; and checking the antenna height, azimuth, and down tilt anglesagainst predetermined specifications.

The close-out audit method 1350 can also include identifying cabling andconnectivity between the cell site components from the video capture anddistinguishing in the close-out audit package. The close-out auditmethod 1350 can also include checking a plurality of factors in theclose-out audit from the video capture compared to the operator orowner's guidelines. The close-out audit method 1350 can also includechecking the grounding of the cell site components from the videocapture, comparing the checked grounding to the operator or owner'sguidelines and distinguishing in the close-out audit package. Theclose-out audit method 1350 can also include checking mechanicalconnectivity of the cell site components to a cell tower based on thevideo capture and distinguishing in the close-out audit package.

The close-out audit package can include, without limitation, drawings,cell site component settings, test results, equipment lists, pictures,commissioning data, GPS data, Antenna height, azimuth and down tiltdata, equipment data, serial numbers, cabling, etc.

§ 14.0 3D Modeling Systems and Methods

FIG. 25 is a flowchart of a 3D modeling method 1400 to detectconfiguration and site changes. The 3D modeling method 1400 utilizesvarious techniques to obtain data, to create 3D models, and to detectchanges in configurations and surroundings. The 3D models can be createdat two or more different points in time, and with the different 3Dmodels, a comparison can be made to detect the changes. Advantageously,the 3D modeling systems and methods allow cell site operators to managethe cell sites without repeated physical site surveys efficiently.

The modeling method 1400 includes obtaining first data regarding thecell site from a first audit performed using one or more dataacquisition techniques and obtaining second data regarding the cell sitefrom a second audit performed using the one or more data acquisitiontechniques, wherein the second audit is performed at a different timethan the first audit, and wherein the first data and the second dataeach comprise one or more location identifiers associated therewith(step 1402); processing the first data to define a first model of thecell site using the associated one or more location identifiers andprocessing the second data to define a second model of the cell siteusing the associated one or more location identifiers (step 1404);comparing the first model with the second model to identify the changesin or at the cell site (step 1406); and performing one or more actionsbased on the identified changes (step 1408).

The one or more actions can include any remedial or corrective actionsincluding maintenance, landscaping, mechanical repair, licensing fromoperators who install more cell site components 14 than agreed upon, andthe like. The identified changes can be associated with cell sitecomponents installed on a cell tower at the cell site, and wherein theone or more actions comprises any of maintenance, licensing withoperators, and removal. The identified changes can be associated withphysical surroundings of the cell site, and wherein the one or moreactions comprise maintenance to correct the identified changes. Theidentified changes can include any of degradation of gravel roads, treesobstructing a cell tower, physical hazards at the cell site, andmechanical issues with the cell tower or a shelter at the cell site.

The first data and the second data can be obtained remotely, without atower climb. The first model and the second model each can include athree-dimensional model of the cell site, displayed in a Graphical UserInterface (GUI). The one or more data acquisition techniques can includeusing an Unmanned Aerial Vehicle (UAV) to capture the first data and thesecond data. The one or more data acquisition techniques can includeusing a fixed or portable camera to capture the first data and thesecond data. The one or more location identifiers can include at leasttwo location identifiers comprising Global Positioning Satellite (GPS)and GLObal NAvigation Satellite System (GLONASS). The second model canbe created using the first model as a template for expected objects atthe cell site.

§ 15.0 3D Modeling Data Capture Systems and Methods

Again, various embodiments herein describe applications and use of 3Dmodels of the cell site 10 and the cell tower 12. Further, it has beendescribed using the UAV 50 to obtain data capture for creating the 3Dmodel. The data capture systems and methods described herein providevarious techniques and criteria for properly capturing images or videousing the UAV 50. Referring to FIG. 26 is a flow diagram of a 3D modelcreation method 1700. The 3D model creation method 1700 is implementedon a server or the like. The 3D model creation method 1700 includesreceiving input data, i.e., pictures and/or video. The data capturesystems and methods describe various techniques for obtaining thepictures and/or video using the UAV 50 at the cell site 10. In anembodiment, the pictures can be at least 10 megapixels, and the videocan be at least 4k high definition video.

The 3D model creation method 1700 performs initial processing on theinput data (step 1702). An output of the initial processing includes asparse point cloud, a quality report, and an output file can be cameraoutputs. The sparse point cloud is processed into a point cloud and mesh(step 1704) providing a densified point cloud and 3D outputs. The 3Dmodel is an output of the step 1704. Other models can be developed byfurther processing the densified point cloud (step 1706) to provide aDigital Surface Model (DSM), an orthomosaic, tiles, contour lines, etc.

The data capture systems and methods include capturing thousands ofimages or video which can be used to provide images. FIG. 27 isflowchart of a method 1750 using a UAV to obtain data capture at a cellsite for developing a 3D model thereof. The method 1750 includes causingthe UAV to fly a given flight path about a cell tower at the cell site(step 1752); obtaining data capture during the flight path about thecell tower, wherein the data capture comprises a plurality of photos orvideo, wherein the flight path is subjected to a plurality ofconstraints for the obtaining, and wherein the data capture comprisesone or more location identifiers (step 1754); and, subsequent to theobtaining, processing the data capture to define a 3D model of the cellsite based on one or more objects of interest in the data capture (step1756).

The method 1750 can further include remotely performing a site survey ofthe cell site utilizing a GUI of the 3D model to collect and obtaininformation about the cell site, the cell tower, one or more buildings,and interiors thereof (step 1758). As a launch location and launchorientation can be defined for the UAV to take off and land at the cellsite such that each flight at the cell site has the same launch locationand launch orientation. The one or more location identifiers can includeat least two location identifiers including GPS and GLONASS.

The plurality of constraints can include each flight of the UAV having asimilar lighting condition and at about a same time of day.Specifically, the data capture can be performed on different days ortimes to update the 3D model. Importantly, the method 1750 can requirethe data capture in the same lighting conditions, e.g., sunny, cloudy,etc., and at about the same time of day to account for shadows.

The data capture can include a plurality of photographs each with atleast 10 megapixels and wherein the plurality of constraints can includeeach photograph having at least 75% overlap with another photograph.Specifically, the significant overlap allows for ease in processing tocreate the 3D model. The data capture can include a video with at least4k high definition and wherein the plurality of constraints can includecapturing a screen from the video as a photograph having at least 75%overlap with another photograph captured from the video.

The plurality of constraints can include a plurality of flight pathsaround the cell tower with each of the plurality of flight paths at oneor more of different elevations, different camera angles, and differentfocal lengths for a camera. The plurality of flight paths can be one ofa first flight path at a first height and a camera angle and a secondflight path at a second height and the camera angle; and a first flightpath at the first height and a first camera angle and a second flightpath at the first height and a second camera angle. The plurality offlight paths can be substantially circular around the cell tower.

§ 15.1 3D Methodology for Cell Sites

FIG. 28 is a flowchart of a 3D modeling method 1800 for capturing dataat the cell site 10, the cell tower 12, etc. using the UAV 50. Themethod 1800, in addition to or in combination with the method 1750,provides various techniques for accurately capturing data for building apoint cloud generated a 3D model of the cell site 10. First, the dataacquisition, i.e., the performance of the method 1800, should beperformed in the early morning or afternoon such that nothing isoverexposed and there is a minimum reflection off of the cell tower 12.It is also important to have a low Kp Index level to minimize thedisruption of geomagnetic activity on the UAV's GPS unit, sub level sixis adequate for 3D modeling as described in this claim. Of course, it isalso important to ensure the camera lenses on the UAV 50 are clean priorto launch. This can be done by cleaning the lenses with alcohol and awipe. Thus, the method 1800 includes preparing the UAV 50 for flight andprogramming an autonomous flight path about the cell tower 12 (step1802).

The UAV 50 flight about the cell tower 12 at the cell site 10 can beautonomous, i.e., automatic without manual control of the actual flightplan in real-time. The advantage here with autonomous flight is theflight of the UAV 50 is circular as opposed to a manual flight which canbe more elliptical, oblong, or have gaps in data collection, etc. In anembodiment, the autonomous flight of the UAV 50 can capture dataequidistance around the planned circular flight path by using a Point ofInterest (POI) flight mode. The POI flight mode is selected (eitherbefore or after takeoff), and once the UAV 50 is in flight, an operatorcan select a point of interest from a view of the UAV 50, such as butnot limited to via the mobile device 100 which is in communication withthe UAV 50. The view is provided by the camera 86, and the UAV 50 inconjunction with the device identifier to be in communication with theUAV 50 can determine a flight plan about the point of interest. In themethod 1800, the point of interest can be the cell tower 12. The pointof interest can be selected at an appropriate altitude and onceselected, the UAV 50 circles in flight about the point of interest.Further, the radius, altitude, direction, and speed can be set to thepoint of interest flight as well as a number of repetitions of thecircle. Advantageously, the point of interest flight path in a circleprovides an even distance about the cell tower 12 for obtaining photosand video thereof for the 3D model. In an embodiment of a tape dropmodel, the UAV 50 will perform four orbits about a monopole cell tower12 and about five or six orbits about a self-support/guyed cell tower12. In the embodiment of a structural analysis model, the number oforbits will be increased from 2 to 3 times to acquire the data needed toconstruct a more realistic graphics user interface model.

Additionally, the preparation can also include focusing the camera 86 inits view of the cell tower 12 to set the proper exposure. Specifically,if the camera 86's view is too bright or too dark, the 3D modelingsoftware will have issues in matching pictures or frames together tobuild the 3D model.

Once the preparation is complete and the flight path is set (step 1802),the UAV 50 flies in a plurality of orbits about the cell tower 12 (step1804). The UAV obtains photos and/or video of the cell tower 12 and thecell site components 14 during each of the plurality of orbits (step1806). Note, each of the plurality of orbits has differentcharacteristics for obtaining the photos and/or video. Finally, photosand/or video is used to define a 3D model of the cell site 10 (step1808).

For the plurality of orbits, a first orbit is around the entire cellsite 10 to cover the entire cell tower 12 and associated surroundings.For monopole cell towers 12, the radius of the first orbit willtypically range from 100 to 150 ft. For self-support cell towers 12, theradius can be up to 200 ft. The UAV 50's altitude should be slightlyhigher than that of the cell tower for the first orbit. The camera 86should be tilted slightly down capturing more ground in the backgroundthan sky to provide more texture helping the software match the photos.The first orbit should be at a speed of about 4 ft/second (this providesa good speed for battery efficiency and photo spacing). A photo shouldbe taken around every two seconds or at 80 percent overlap decreasingthe amount that edges and textures move from each photo. This allows thesoftware to relate those edge/texture points to each photo called tiepoints.

A second orbit of the plurality of orbits should be closer to theradiation centers of the cell tower 12, typically 30 to 50 ft with analtitude still slightly above the cell tower 12 with the camera 86pointing downward. The operator should make sure all the cell sitecomponents 12 and antennas are in the frame including those on theopposite side of the cell tower 12. This second orbit will allow the 3Dmodel to create better detail on the structure and equipment in betweenthe antennas and the cell site components 14. This will allowcontractors to make measurements on equipment between those antennas.The orbit should be done at a speed around 2.6 ft/second and still takephotos close to every 2 seconds or keeping an 80 percent overlap.

A third orbit of the plurality of orbits has a lower altitude to aroundthe mean distance between all of the cell site components 14 (e.g.,Radio Access Devices (RADs)). With the lower altitude, the camera 86 israised up such as 5 degrees or more because the ground will have movedup in the frame. This new angle and altitude will allow a full profileof all the antennas and the cell site components 14 to be captured. Theorbit will still have a radius around 30 to 50 ft with a speed of about2.6 ft/second.

The next orbit should be for a self-support cell tower 12. Here, theorbit is expanded to around 50 to 60 ft, and the altitude decreasedslightly below the cell site components 14 and the camera 86 angledslightly down more capturing all of the cross barring of theself-support structure. All of the structure to the ground does not needto be captured for this orbit but close to it. The portion close to theground will be captured in the next orbit. However, there needs to beclear spacing in whatever camera angle is chosen. The cross members inthe foreground should be spaced enough for the cross members on theother side of the cell tower 12 to be visible. This is done forself-support towers 12 because of the complexity of the structure andthe need for better detail which is not needed for monopoles in thisarea. The first orbit for monopoles provides more detail because theyare at a closer distance with the cell towers 12 lower height. The speedof the orbit can be increased to around 3 ft/second with the samespacing.

The last orbit for all cell towers 12 should have an increased radius toaround 60 to 80 ft with the camera 86 looking more downward at the cellsite 10. The altitude should be decreased to get closer to the cell site10 compound. The altitude should be around 60 to 80 ft but will changeslightly depending on the size of the cell site 10 compound. The angleof the camera 86 with the altitude should be such as where the sides andtops of structures such as the shelters will be visible throughout theorbit. It is important to make sure the whole cell site 10 compound isin the frame for the entire orbit allowing the capture of every side ofeverything inside the compound including the fencing. The speed of theorbit should be around 3.5 ft/second with same photo time spacing andoverlap.

The total amount of photos that should be taken for a monopole celltower 12 should be around 300-400 and the total amount of photos forself-support cell tower 12 should be between 400-500 photos. Too manyphotos can indicate that the photos were taken too close together.Photos taken in succession with more than 80 percent overlap can causeerrors in the processing of the model and cause extra noise around thedetails of the tower and lower the distinguishable parts for thesoftware.

§ 16.0 3D Modeling Data Capture Systems and Methods Using MultipleCameras

FIGS. 29A and 29B are block diagrams of a UAV 50 with multiple cameras86A, 86B, 86C (FIG. 29A) and a camera array 1900 (FIG. 29B). The UAV 50can include the multiple cameras 86A, 86B, 86C which can be locatedphysically apart on the UAV 50. In another embodiment, the multiplecameras 86A, 86B, 86C can be in a single housing. In all embodiments,each of the multiple cameras 86A, 86B, 86C can be configured to take apicture of a different location, different area, different focus, etc.That is, the cameras 86A, 86B, 86C can be angled differently, have adifferent focus, etc. The objective is for the cameras 86A, 86B, 86Ctogether to cover a larger area than a single camera 86. In aconventional approach for 3D modeling, the camera 86 is configured totake hundreds of pictures for the 3D model. For example, as describedwith respect to the 3D modeling method 1800, 300-500 pictures arerequired for an accurate 3D model. In practice, using the limitationsdescribed in the 3D modeling method 1800, this process, such as with theUAV 50, can take hours. It is the objective of the systems and methodswith multiple cameras to streamline this process such as reduce thistime by half or more. The cameras 86A, 86B, 86C are coordinated andcommunicatively coupled to one another and the processor 102.

In FIG. 29B, the camera array 1900 includes a plurality of cameras 1902.Each of the cameras 1902 can be individual cameras each with its ownsettings, i.e., angle, zoom, focus, etc. The camera array 1900 can bemounted on the UAV 50, such as the camera 86. The camera array 1900 canalso be portable, mounted on or at the cell site 10, and the like.

In the systems and methods herein, the cameras 86A, 86B, 86C and thecamera array 1900 are configured to work cooperatively to obtainpictures to create a 3D model. In an embodiment, the 3D model is a cellsite 10. As described herein, the systems and methods utilize at leasttwo cameras, e.g., the cameras 86A, 86B, or two cameras 1902 in thecamera array 1900. Of course, there can be greater than two cameras. Themultiple cameras are coordinated such that one event where pictures aretaken produce at least two pictures. Thus, to capture 300-500 pictures,less than 150-250 pictures are actually taken.

FIG. 30 is a flowchart of a method 1950 using multiple cameras to obtainaccurate 3D modeling data. In the method 1950, the multiple cameras areused with the UAV 50, but other embodiments are also contemplated. Themethod 1950 includes causing the UAV to fly a given flight path about acell tower at the cell site (step 1952); obtaining data capture duringthe flight path about the cell tower, wherein the data capture includesa plurality of photos or video subject to a plurality of constraints,wherein the plurality of photos are obtained by a plurality of cameraswhich are coordinated with one another (step 1954); and, subsequent tothe obtaining, processing the data capture to define a 3D model of thecell site based on one or more objects of interest in the data capture(step 1956). The method 1950 can further include remotely performing asite survey of the cell site utilizing a GUI of the 3D model to collectand obtain information about the cell site, the cell tower, one or morebuildings, and interiors thereof (step 1958). The flight path caninclude a plurality of orbits comprising at least four orbits around thecell tower each with a different set of characteristics of altitude,radius, and camera angle.

A launch location and launch orientation can be defined for the UAV totake off and land at the cell site such that each flight at the cellsite has the same launch location and launch orientation. The pluralityof constraints can include each flight of the UAV having a similarlighting condition and at about a same time of day. A total number ofphotos can include around 300-400 for the monopole cell tower and500-600 for the self-support cell tower, and the total number is takenconcurrently by the plurality of cameras. The data capture can include aplurality of photographs each with at least 10 megapixels and whereinthe plurality of constraints comprises each photograph having at least75% overlap with another photograph. The data capture can include avideo with at least 4k high definition and wherein the plurality ofconstraints can include capturing a screen from the video as aphotograph having at least 75% overlap with another photograph capturedfrom the video. The plurality of constraints can include a plurality offlight paths around the cell tower with each of the plurality of flightpaths at one or more of different elevations and each of the pluralityof cameras with different camera angles and different focal lengths.

In another embodiment, an apparatus adapted to obtain data capture at acell site for developing a 3D model thereof includes a network interfaceand a processor communicatively coupled to one another; and memorystoring instructions that, when executed, cause the processor to causethe UAV to fly a given flight path about a cell tower at the cell site;obtain data capture during the flight path about the cell tower, whereinthe data capture comprises a plurality of photos or video subject to aplurality of constraints, wherein the plurality of photos are obtainedby a plurality of cameras which are coordinated with one another; andprocess the obtained data capture to define a 3D model of the cell sitebased on one or more objects of interest in the data capture.

§ 17.0 Multiple Camera Apparatus and Process

FIGS. 31 and 32 are diagrams of a multiple camera apparatus 2000 and useof the multiple camera apparatus 2000 in the shelter or cabinet 52 orthe interior 900 of the building 902. As previously described herein,the camera 930 can be used in the interior 900 for obtaining photos for3D modeling and for virtual site surveys. The multiple camera apparatus2000 is an improvement to the camera 930, enabling multiple photos to betaken simultaneously of different views, angles, zoom, etc. In anembodiment, the multiple camera apparatus 2000 can be operated by atechnician at the building 902 to quickly, efficiently, and properlyobtain photos for a 3D model of the interior 900. In another embodiment,the multiple camera apparatus 2000 can be mounted in the interior 900and remotely controlled by an operator.

The multiple camera apparatus 2000 includes a post 2002 with a pluralityof cameras 2004 disposed or attached to the post 2002. The plurality ofcameras 2004 can be interconnected to one another and to a control unit2006 on the post. The control unit 2006 can include user controls tocause the cameras 2004 to each take a photo and memory for storing thephotos from the cameras 2004. The control unit 2006 can further includecommunication mechanisms to provide the captured photos to a system for3D modeling (either via a wired and/or wireless connection). In anembodiment, the post 2002 can be about 6′ and the cameras 2004 can bepositioned to enable data capture from the floor to the ceiling of theinterior 900.

The multiple camera apparatus 2000 can include other physicalembodiments besides the post 2002. For example, the multiple cameraapparatus 2000 can include a box with the multiple cameras 2004 disposedtherein. In another example, the multiple camera apparatus 2000 caninclude a handheld device which includes the multiple cameras 2004.

The objective of the multiple camera apparatus 2000 is to enable atechnician (either on-site or remote) to quickly capture photos (throughthe use of the multiple cameras 2004) for a 3D model and to properlycapture the photos (through the multiple cameras 2004 have differentzooms, angles, etc.). That is, the multiple camera apparatus 2000ensures the photo capture is sufficient to accurately develop the 3Dmodel, avoiding potentially revisiting the building 902.

FIG. 33 is a flowchart of a data capture method 2050 in the interior 900using the multiple camera apparatus 2000. The method 2050 includesobtaining or providing the multiple camera apparatus 2000 at the shelteror cabinet 52 or the interior 900 of the building 902 and positioningthe multiple camera apparatus 2000 therein (step 2052). The method 2050further includes causing the plurality of cameras 2004 to take photosbased on the positioning (step 2054) and repositioning the multiplecamera apparatus 2000 at a different location in the shelter or cabinet52 or the interior 900 of the building 902 to take additional photos(step 2056). Finally, the photos taken by the cameras 2004 are providedto a 3D modeling system to develop a 3D model of the shelter or cabinet52 or the interior 900 of the building 902, such as for a virtual sitesurvey (step 2058).

The repositioning step 2056 can include moving the multiple cameraapparatus to each corner of the shelter, the cabinet, or the interior ofthe building. The repositioning step 2056 can include moving themultiple camera apparatus to each row of equipment in the shelter, thecabinet, or the interior of the building. The multiple camera apparatuscan include a pole with the plurality of cameras disposed thereon, eachof the plurality of cameras configured for a different view. Theplurality of cameras are communicatively coupled to a control unit forthe causing step 2054 and/or the providing step 2058. Each of theplurality of cameras can be configured on the multiple camera apparatusfor a different view, zoom, and/or angle. The method 2050 can includeanalyzing the photos subsequent to the repositioning, and determiningwhether the photos are suitable for the 3D model, and responsive to thephotos not being suitable for the 3D model, instructing a user to retakethe photos which are not suitable. The method 2050 can include combingthe photos of the shelter, the cabinet, or the interior of the buildingwith photos of a cell tower at the cell site, to form a 3D model of thecell site. The method 2050 can include performing a virtual site surveyof the cell site using the 3D model. The repositioning step 2056 can bebased on a review of the photos taken in the causing.

§ 18.0 Cell Site Verification Using 3D Modeling

FIG. 34 is a flowchart of a method 2100 for verifying equipment andstructures at the cell site 10 using 3D modeling. As described herein,an intermediate step in the creation of a 3D model includes a pointcloud, e.g., a sparse or dense point cloud. A point cloud is a set ofdata points in some coordinate system, e.g., in a three-dimensionalcoordinate system, these points are usually defined by X, Y, and Zcoordinates, and can be used to represent the external surface of anobject. Here, the object can be anything associated with the cell site10, e.g., the cell tower 12, the cell site components 14, etc. As partof the 3D model creation process, a large number of points on anobject's surface are determined, and the output is a point cloud in adata file. The point cloud represents the set of points that the devicehas measured.

Various descriptions were presented herein for site surveys, close-outaudits, etc. In a similar manner, there is a need to continually monitorthe state of the cell site 10. Specifically, as described herein,conventional site monitoring techniques typically include tower climbs.The UAV 50 and the various approaches described herein provide safe andmore efficient alternatives to tower climbs. Additionally, the UAV 50can be used to provide cell site 10 verification to monitor for sitecompliance, structural or load issues, defects, and the like. The cellsite 10 verification can utilize point clouds to compare “before” and“after” data capture to detect differences.

With respect to site compliance, the cell site 10 is typically owned andoperated by a cell site operator (e.g., real estate company or the like)separate from cell service providers with their associated cell sitecomponents 14. The typical transaction includes leases between theseparties with specific conditions, e.g., the number of antennas, theamount of equipment, the location of equipment, etc. It is advantageousfor cell site operators to periodically audit/verify the state of thecell site 10 with respect to compliance, i.e., has cell service providerA added more cell site components 14 than authorized? Similarly, it isimportant for cell site operators to periodically check the cell site 10to proactively detect load issues (too much equipment on the structureof the cell tower 12), defects (equipment detached from the structure),etc.

One approach to verifying the cell site 10 is a site survey, includingthe various approaches to site surveys described herein, including theuse of 3D models for remote site surveys. In various embodiments, themethod 2100 provides a quick and automated mechanism to quickly detectconcerns (i.e., compliance issues, defects, load issues, etc.) usingpoint clouds. Specifically, the method 2100 includes creating an initialpoint cloud for a cell site 10 or obtaining the initial point cloud froma database (step 2102). The initial point cloud can represent a knowngood condition, i.e., with no compliance issues, load issues, defects,etc. For example, the initial point cloud could be developed as part ofthe close-out audit, etc. The initial point cloud can be created usingthe various data acquisition techniques described herein using the UAV50. Also, a database can be used to store the initial point cloud.

The initial point cloud is loaded in a device, such as the UAV 50 (step2104). The point cloud data files can be stored in the memory in aprocessing device associated with the UAV 50. In an embodiment, multiplepoint cloud data files can be stored in the UAV 50, allowing the UAV 50to be deployed to perform the method 2100 at a plurality of cell sites10. The device (UAV 50) can be used to develop a second point cloudbased on current conditions at the cell site 10 (step 2106). Again, theUAV 50 can use the techniques described herein relative to dataacquisition to develop the second point cloud. Note, it is preferable touse a similar data acquisition for both the initial point cloud and thesecond point cloud, e.g., similar takeoff locations/orientations,similar paths about the cell tower 12, etc. This ensures similarity inthe data capture. In an embodiment, the initial point cloud is loaded tothe UAV 50 along with instructions on how to perform the dataacquisition for the second point cloud. The second point cloud isdeveloped at a current time, i.e., when it is desired to verify aspectsassociated with the cell site 10.

Variations are detected between the initial point cloud and the secondpoint cloud (step 2108). The variations could be detected by the UAV 50,in an external server, in a database, etc. The objective here is theinitial point cloud and the second point cloud provides a quick andefficient comparison to detect differences, i.e., variations. The method2100 includes determining if the variations are ant of compliancerelated, load issues, or defects (step 2110). Note, variations can besimply detected based on raw data differences between the point clouds.The step 2110 requires additional processing to determine what theunderlying differences are. In an embodiment, the variations aredetected in the UAV 50, and, if detected, additional processing isperformed by a server to actually determine the differences based oncreating a 3D model of each of the point clouds. Finally, the secondpoint cloud can be stored in the database for future processing (step2112). An operator of the cell site 10 can be notified via any techniqueof any determined variations or differences for remedial action basedthereon (addressing non-compliance, performing maintenance to fixdefects or load issues, etc.).

§ 19.0 Cell Site Audit and Survey Via Photo Stitching

Photo stitching or linking is a technique where multiple photos ofeither overlapping fields of view or adjacent fields of view are linkedtogether to produce a virtual view or segmented panorama of an area. Acommon example of this approach is the so-called Street view offered byonline map providers. In various embodiments, the systems and methodsenable a remote user to perform a cell site audit, survey, siteinspection, etc. using a User Interface (UI) with photostitching/linking to view the cell site 10. The various activities caninclude any of the aforementioned activities described herein. Further,the photos can also be obtained using any of the aforementionedtechniques. Of note, the photos required for a photo stitched UI aresignificantly less than those required by the 3D model. However, thephoto stitched UI can be based on the photos captured for the 3D model,e.g., a subset of the photos. Alternatively, the photo capture for thephoto stitched UI can be captured separately. Variously, the photos forthe UI are captured, and a linkage is provided between photos. Thelinkage allows a user to navigate between photos to view up, down, left,or right, i.e., to navigate the cell site 10 via the UI. The linkage canbe noted in a photo database with some adjacency indicator. The linkagecan be manually entered via a user reviewing the photos or automaticallybased on location tags associated with the photos.

FIG. 35 is a diagram of a photo stitching UI 2200 for cell site audits,surveys, inspections, etc. remotely. The UI 2200 is viewed by a computeraccessing a database of a plurality of photos with the linkage betweeneach other based on adjacency. The photos are of the cell site 10 andcan include the cell tower 12 and associated cell site components aswell as interior photos of the shelter or cabinet 52 of the interior900. The UI 2200 displays a photo of the cell site 12 and the user cannavigate to the left to a photo 2202, to the right to a photo 2204, upto a photo 2206, or down to a photo 2208. The navigation between thephotos 2202, 2204, 2206, 2208 is based on the links between the photos.In an embodiment, a navigation icon 2210 is shown in the UI 2200 fromwhich the user can navigate the UI 2200. Also, the navigation caninclude opening and closing a door to the shelter or cabinet 52.

In an embodiment, the UI 2200 can include one of the photos 2202, 2204,2206, 2208 at a time with the navigation moving to a next photo. Inanother embodiment, the navigation can scroll through the photos 2202,2204, 2206, 2208 seamlessly. In either approach, the UI 2200 allowsvirtual movement around the cell site 10 remotely. The photos 2202,2204, 2206, 2208 can each be a high-resolution photo, e.g., 8 megapixelsor more. From the photos 2202, 2204, 2206, 2208, the user can readlabels on equipment, check cable runs, check equipment location andinstallation, check cabling, etc. Also, the user can virtually scale thecell tower 12 avoiding a tower climb. An engineer can use the UI 2200 toperform site expansion, e.g., where to install new equipment. Further,once the new equipment is installed, the associated photos can beupdated to reflect the new equipment. It is not necessary to update allphotos, but rather only the photos of new equipment locations.

The photos 2202, 2204, 2206, 2208 can be obtained using the data capturetechniques described herein. The camera used for capturing the photoscan be a 180, 270, or 360-degree camera. These cameras typically includemultiple sensors allowing a single photo capture to capture a large viewwith a wide lens, fisheye lens, etc. The cameras can be mounted on theUAV 50 for capturing the cell tower 12, the multiple camera apparatus2000, etc. Also, the cameras can be the camera 930 in the interior 900.

FIG. 36 is a flowchart of a method 2300 for performing a cell site auditor survey remotely via a User Interface (UI). The method 2300 includes,subsequent to capturing a plurality of photos of a cell site and linkingthe plurality of photos to one another based on their adjacency at thecell site, displaying the UI to a user remote from the cell site,wherein the plurality of photos cover a cell tower with associated cellsite components and an interior of a building at the cell site (step2302); receiving navigation commands from the user performing the cellsite audit or survey (step 2304); and updating the displaying based onthe navigation commands, wherein the navigation commands comprise one ormore of movement at the cell site and zoom of a current view (step2306). The capturing the plurality of photos can be performed for a celltower with a UAV flying about the cell tower. The linking the pluralityof photos can be performed one of manually and automatically based onlocation identifiers associated with each photo.

The user performing the cell site audit or survey can includedetermining a down tilt angle of one or more antennas of the cell sitecomponents based on measuring three points comprising two defined byeach antenna and one by an associated support bar; determining plumb ofthe cell tower and/or the one or more antennas, azimuth of the one ormore antennas using a location determination in the photos; determiningdimensions of the cell site components; determining equipment type andserial number of the cell site components; and determining connectionsbetween the cell site components. The plurality of photos can becaptured concurrently with developing a three-dimensional (3D) model ofthe cell site. The updating the displaying can include providing a newphoto based on the navigation commands. The updating the displaying caninclude seamlessly panning between the plurality of photos based on thenavigation commands.

§ 20.0 Subterranean 3D Modeling

The foregoing descriptions provide techniques for developing a 3D modelof the cell site 10, the cell tower 12, the cell site components 14, theshelter or cabinet 52, the interior 900 of the building 902, etc. The 3Dmodel can be used for a cell site audit, survey, site inspection, etc.In addition, the 3D model can also include a subterranean model of thesurrounding area associated with the cell site 10. FIG. 37 is aperspective diagram of a 3D model 2400 of the cell site 10, the celltower 12, the cell site components 14, and the shelter or cabinet 52along with surrounding geography 2402 and subterranean geography 2404.Again, the 3D model 2400 of the cell site 10, the cell tower 12, thecell site components 14, and the shelter or cabinet 52 along with a 3Dmodel of the interior 900 can be constructed using the varioustechniques described herein.

In various embodiments, the systems and methods extend the 3D model 2400to include the surrounding geography 2402 and the subterranean geography2404. The surrounding geography 2402 represents the physical locationaround the cell site 10. This can include the cell tower 12, the shelteror cabinet 52, access roads, etc. The subterranean geography 2404includes the area underneath the surrounding geography 2402.

The 3D model 2400 portion of the surrounding geography 2402 and thesubterranean geography 2404 can be used by operators and cell site 10owners for a variety of purposes. First, the subterranean geography 2404can show locations of utility constructions including electrical lines,water/sewer lines, gas lines, etc. Knowledge of the utilityconstructions can be used in site planning and expansion, i.e., where tobuild new structures, where to run new underground utilityconstructions, etc. For example, it would make sense to avoid newabove-ground structures in the surrounding geography 2402 on top of gaslines or other utility constructions if possible. Second, thesubterranean geography 2404 can provide insight into various aspects ofthe cell site 10 such as depth of support for the cell tower 12, theability of the surrounding geography 2402 to support various structures,the health of the surrounding geography 2402, and the like. For example,for new cell site components 14 on the cell tower 12, the 3D model 2400can be used to determine whether there will be support issues, i.e., adepth of the underground concrete supports of the cell tower 12.

Data capture for the 3D model 2400 for the subterranean geography 2404can use various known 3D subterranean modeling techniques such as sonar,ultrasound, LIDAR (Light Detection and Ranging), and the like. Also, thedata capture for the 3D model 2400 can utilize external data sourcessuch as utility databases which can include the location of the utilityconstructions noted by location coordinates (e.g., GPS). In anembodiment, the data capture can be verified with the external datasources, i.e., data from the external data sources can verify the datacapture using the 3D subterranean modeling techniques.

The 3D subterranean modeling techniques utilize a data capture devicebased on the associated technology. In an embodiment, the data capturedevice can be on the UAV 50. In addition to performing the data capturetechniques described herein for the cell tower 12, the UAV 50 canperform data capture by flying around the surrounding geography 2402with the data capture device aimed at the subterranean geography 2404.The UAV 50 can capture data for the 3D model 2400 for both the aboveground components and the subterranean geography 2404.

In another embodiment, the data capture device can be used separatelyfrom the UAV 50, such as via a human operator moving about thesurrounding geography 2402 aiming the data capture device at thesubterranean geography 2404, via a robot or the like with the datacapture device connected thereto, and the like.

FIG. 38 is a flowchart of a method 2400 for creating a 3D model of acell site for one or more of a cell site audit, a site survey, and cellsite planning and engineering. The method 2450 includes obtaining firstdata capture for above ground components including a cell tower,associated cell site components on the cell tower, one or morebuildings, and surrounding geography around the cell site (step 2402);obtaining second data capture for subterranean geography associated withthe surrounding geography (step 2404); utilizing the first data captureand the second data capture to develop the 3D model which includes boththe above ground components and the subterranean geography (step 2406);and utilizing the 3D model to perform the one or more of the site audit,the site survey, and the cell site planning and engineering (step 2408).

The method 2450 can further include obtaining third data capture ofinteriors of the one or more buildings; and utilizing the third datacapture to develop the 3D model for the interiors. The obtaining seconddata capture can be performed with a data capture device using one ofsonar, ultrasound, and LIDAR (Light Detection and Ranging). Theobtaining first data capture can be performed with a UAV flying aboutthe cell tower, and wherein the obtaining second data capture can beperformed with the data capture device on the UAV. The obtaining firstdata capture can be performed with a UAV flying about the cell tower.The first data capture can include a plurality of photos or videosubject to a plurality of constraints, wherein the plurality of photosare obtained by a plurality of cameras which are coordinated with oneanother. The 3D model can be presented in a GUI to perform the one ormore of the site audit, the site survey, and the cell site planning andengineering. The subterranean geography in the 3D model can illustratesupport structures of the cell tower and utility constructions in thesurrounding geography. The method can further include utilizing anexternal data source to verify utility constructions in the second datacapture for the subterranean geography.

§ 21.0 3 D Model of Cell Sites for Modeling Fiber Connectivity

As described herein, various approaches are described for 3D models forcell sites for cell site audits, site surveys, close-out audits, etc.which can be performed remotely (virtual). In an embodiment, the 3Dmodel is further extended to cover surrounding areas focusing on fiberoptic cables near the cell site. Specifically, with the fiberconnectivity in the 3D model, backhaul connectivity can be determinedremotely.

FIG. 39 is a perspective diagram of the 3D model 2400 of the cell site10, the cell tower 12, the cell site components 14, and the shelter orcabinet 52 along with surrounding geography 2402, subterranean geography2404, and fiber connectivity 2500. Again, the 3D model 2400 of the cellsite 10, the cell tower 12, the cell site components 14, and the shelteror cabinet 52 along with a 3D model of the interior 900 can beconstructed using the various techniques described herein. Specifically,FIG. 39 extends the 3D model 2400 in FIG. 38 and in other areasdescribed herein to further include fiber cabling.

As previously described, the systems and methods extend the 3D model2400 to include the surrounding geography 2402 and the subterraneangeography 2404. The surrounding geography 2402 represents the physicallocation around the cell site 10. This can include the cell tower 12,the shelter or cabinet 52, access roads, etc. The subterranean geography2404 includes the area underneath the surrounding geography 2402.Additionally, the 3D model 2400 also includes the fiber connectivity2500 including components above ground in the surrounding geography 2402and as well as the subterranean geography 2404.

The fiber connectivity 2500 can include poles 2502 and cabling 2504 onthe poles 2502. The 3D model 2400 can include the fiber connectivity2500 at the surrounding geography 2402 and the subterranean geography2404. Also, the 3D model can extend out from the surrounding geography2402 on a path associated with the fiber connectivity 2500 away from thecell site 10. Here, this can give the operator the opportunity to seewhere the fiber connectivity 2500 extends. Thus, various 3D models 2400can provide a local view of the cell sites 10 as well as fiberconnectivity 2500 in a geographic region. With this information, theoperator can determine how close fiber connectivity 2500 is to currentor future cell sites 10, as well as perform site planning.

A geographic region can include a plurality of 3D models 2400 along withthe fiber connectivity 2500 across the region. A collection of these 3Dmodels 2400 in the region enables operators to perform more efficientsite acquisition and planning.

Data capture of the fiber connectivity 2500 can be through the UAV 50 asdescribed herein. Advantageously, the UAV 50 is efficient to capturephotos or video of the fiber connectivity 2500 without requiring siteaccess (on the ground) as the poles 2502 and the cabling 2504 maytraverse private property, etc. Also, other forms of data capture arecontemplated such as via a car with a camera, a handheld camera, etc.

The UAV 50 can be manually flown at the cell site 10, and once thecabling 2504 is identified, an operator can trace the cabling 2504 tocapture photos or video for creating the 3D model 2400 with the fiberconnectivity 2500. For example, the operator can identify the fiberconnectivity 2500 near the cell site 10 in the surrounding geography2402 and then cause the UAV 50 to fly a path similar to the path takenby the fiber connectivity 2500 while performing data capture. Once thedata is captured, the photos or video can be used to develop a 3D modelof the fiber connectivity 2500 which can be incorporated in the 3D model2400. Also, the data capture can use the techniques for the subterraneangeography 2404 as well.

FIG. 40 is a flowchart of a method 2550 for creating a 3D model of acell site and associated fiber connectivity for one or more of a cellsite audit, a site survey, and cell site planning and engineering. Themethod 2550 includes determining fiber connectivity at or near the cellsite (step 2552); obtaining first data capture of the fiber connectivityat or near the cell site (step 2554); obtaining second data capture ofone or more paths of the fiber connectivity from the cell site (step2556); obtaining third data capture of the cell site including a celltower, associated cell site components on the cell tower, one or morebuildings, and surrounding geography around the cell site (step 2558);utilizing the first data capture, the second data capture, and the thirddata capture to develop the 3D model which comprises the cell site andthe fiber connectivity (step 2560); and utilizing the 3D model toperform the one or more of the site audit, the site survey, and the cellsite planning and engineering (step 2560).

The method 2550 can further include obtaining fourth data capture forsubterranean geography associated with the surrounding geography of thecell site; and utilizing the fourth data capture with the first datacapture, the second data capture, and the third data capture to developthe 3D model. The fourth data capture can be performed with a datacapture device using one of sonar, ultrasound, photogrammetry, and LIDAR(Light Detection and Ranging).

The method 2550 can further include obtaining fifth data capture ofinteriors of one or more buildings at the cell site; and utilizing thefifth data capture with the first data capture, the second data capture,the third data capture, and the fourth data capture to develop the 3Dmodel. The obtaining first data capture and the obtaining second datacapture can be performed with a UAV flying about the cell tower with adata capture device on the UAV. An operator can cause the UAV to fly theone or more paths to obtain the second data capture.

The obtaining first data capture, the obtaining second data capture, andthe obtaining third data capture can be performed with a UAV flyingabout the cell tower with a data capture device on the UAV. The thirddata capture can include a plurality of photos or video subject to aplurality of constraints, wherein the plurality of photos are obtainedby a plurality of cameras which are coordinated with one another. The 3Dmodel can be presented in a GUI to perform the one or more of the siteaudit, the site survey, and the cell site planning and engineering.

In a further embodiment, an apparatus adapted to create a 3D model of acell site and associated fiber connectivity for one or more of a cellsite audit, a site survey, and cell site planning and engineeringincludes a network interface, a data capture device, and a processorcommunicatively coupled to one another; and memory storing instructionsthat, when executed, cause the processor to determine fiber connectivityat or near the cell site based on feedback from the data capture device;obtain first data capture of the fiber connectivity at or near the cellsite; obtain second data capture of one or more paths of the fiberconnectivity from the cell site; obtain third data capture of the cellsite including a cell tower, associated cell site components on the celltower, one or more buildings, and surrounding geography around the cellsite; utilize the first data capture, the second data capture, and thethird data capture to develop the 3D model which comprises the cell siteand the fiber connectivity; and utilize the 3D model to perform the oneor more of the site audit, the site survey, and the cell site planningand engineering.

§ 22.0 Detecting Changes at the Cell Site and Surrounding Area UsingUAVs

FIG. 41 is a perspective diagram of a cell site 10 with the surroundinggeography 2402. FIG. 41 is an example of a typical cell site. The celltower 12 can generally be classified as a self-support tower, a monopoletower, and a guyed tower. These three types of cell towers 12 havedifferent support mechanisms. The self-support tower can also bereferred to as a lattice tower, and it is free standing, with atriangular base with three or four sides. The monopole tower is a singletube tower, and it is also free-standing, but typically at a lowerheight than the self-support tower. The guyed tower is a straight rodsupported by wires attached to the ground. The guyed tower needs to beinspected every 3 years, or so, the self-support tower needs to beinspected every 5 years, and the monopole tower needs to be inspectedevery 7 years. Again, the owners (real estate companies generally) ofthe cell site 10 have to be able to inspect these sites efficiently andeffectively, especially given the tremendous number of sites—hundreds ofthousands.

A typical cell site 10 can include the cell tower 12 and the associatedcell site components 14 as described herein. The cell site 10 can alsoinclude the shelter or cabinet 52 and other physicalstructures—buildings, outside plant cabinets, etc. The cell site 10 caninclude aerial cabling, an access road 2600, trees, etc. The cell siteoperator is generally concerned about the integrity of all of theaspects of the cell site 10 including the cell tower 12 and the cellsite components 14 as well as everything in the surrounding geography2402. In general, the surrounding geography 2402 can be about an acre;although other sizes are also seen.

Conventionally, the cell site operator had inspections performedmanually with on-site personnel, with a tower climb, and with visualinspection around the surrounding geography 2402. The on-site personnelcan capture data and observations and then return to the office tocompare and contrast with engineering records. That is, the on-sitepersonnel capture data, it is then compared later with existing siteplans, close-out audits, etc. This process is time-consuming and manual.

To address these concerns, the systems and methods propose a combinationof the UAV 50 and 3D models of the cell site 10 and surroundinggeography 2402 to quickly capture and compare data. This capture andcompare can be done in one step on-site, using the UAV 50 and optionallythe mobile device 100, quickly and accurately. First, an initial 3Dmodel 2400 is developed. This can be part of a close-out audit or partof another inspection. The 3D model 2400 can be captured using the 3Dmodeling systems and methods described herein. This initial 3D model2400 can be referred to as a known good situation. The data from the 3Dmodel 2400 can be provided to the UAV 50 or the mobile device 100, and asubsequent inspection can use this initial 3D model 2400 tosimultaneously capture current data and compare the current data withthe known good situation. Any deviations are flagged. The deviations canbe changes to the physical infrastructure, structural problems, grounddisturbances, potential hazards, loss of gravel on the access road 2600such as through wash out, etc.

FIG. 42 is a flowchart of a method 2650 for cell site inspection by acell site operator using the UAV 50 and a processing device, such as themobile device 100 or a processor associated with the UAV 50. The method2650 includes creating an initial computer model of a cell site andsurrounding geography at a first point in time, wherein the initialcomputer model represents a known good state of the cell site and thesurrounding geography (step 2652); providing the initial computer modelto one or more of the UAV and the processing device (step 2654);capturing current data of the cell site and the surrounding geography ata second point in time using the UAV (step 2656); comparing the currentdata to the initial computer model by the processing device (step 2658);and identifying variances between the current data and the initialcomputer model, wherein the variances comprise differences at the cellsite and the surrounding geography between the first point in time andthe second point in time (step 2660).

The method can further include specifically describing the variancesbased on comparing the current data and the initial computer model,wherein the variances comprise any of changes to a cell tower, changesto cell site components on the cell tower, ground hazards, state of anaccess road, and landscape changes in the surrounding geography. Theinitial computer model can be a 3D model describing a point cloud, andwhere the comparing comprises a comparison of the current data to thepoint cloud. The initial computer model can be determined as part of oneof a close-out audit and a site inspection where it is determined theinitial computer model represents the known good state. The UAV can beutilized to capture data from the initial computer model, and the UAV isutilized in the capturing the current data. A flight plan of the UAVaround a cell tower can be based on a type of the cell tower includingany of a self-support tower, a monopole tower, and a guyed tower. Theinitial computer model can be a 3D model viewed in a GUI, and whereinthe method can further include creating a second 3D model based on thecurrent data and utilizing the second 3D model if it is determined thecell site is in the known good state based on the current data.

§ 23.0 Virtual 360 View Systems and Methods

FIG. 43 is a flowchart of a virtual 360 view method 2700 for creatingand using a virtual 360 environment. The method 2700 is describedreferencing the cell site 10 and using the UAV 50; those skilled in theart will recognize that other types of telecommunication sites are alsocontemplated such as data centers, central offices, regenerator huts,etc. The objective of the method 2700 is to create the virtual 360environment and an example virtual 360 environment is illustrated inFIGS. 44-53.

The method 2700 includes various data capture steps including capturing360-degree photos at multiple points around the ground portion of thecell site 10 (step 2702), capturing 360-degree photos of the cell tower12 and the surrounding geography 2402 with the UAV 50 (step 2704), andcapturing photos inside the shelter or cabinet 52 (step 2706). Once allof the data is captured, the method 2700 includes stitching the variousphotos together with linking to create the virtual 360-degree viewenvironment (step 2708). The virtual 360-degree view environment can behosted on a server, in the cloud, etc. and accessible remotely such asvia a URL or the like. The hosting device can enable display of thevirtual 360-degree view environment for an operator to virtually visitthe cell site 10 and perform associated functions (step 2710). Forexample, the operator can access the virtual 360-degree view environmentvia a tablet, computer, mobile device, etc. and perform a site survey,site audit, site inspection, etc. for various purposes such asmaintenance, installation, upgrades, etc.

An important aspect of the method 2700 is proper data capture of thevarious photos. For step 2702, the photos are preferably captured with a360-degree camera or the like. The multiple points for the groundportion of the cell site 10 can include taking one or more photos ateach corner of the cell site 10 to get all of the angles, e.g., at eachpoint of a square or rectangle defining the surrounding geography 2402.Also, the multiple points can include photos at gates for a walkingpath, access road, etc. The multiple points can also include pointsaround the cell tower 12 such as at the base of the cell tower, pointsbetween the cell tower 12 and the shelter or cabinet 52, points aroundthe shelter or cabinet 52 including any ingress (doors) points. Thephotos can also include the ingress points into the shelter or cabinet52 and then systematically working down the rows of equipment in theshelter or cabinet 52 (which is covered in step 2706).

For step 2704, the UAV 50 can employ the various techniques describedherein. In particular, the UAV 50 is used to take photos at the top ofthe cell tower 12 including the surrounding geography 2402. Also, theUAV 50 is utilized to take detailed photos of the cell site components14 on the cell tower 12, such as sector photos of the alpha, beta, andgamma sectors to show the front of the antennas and the direction eachantenna is facing. Also, the UAV 50 or another device can take photos orvideo of the access road, of a tower climb (with the UAV 50 flying upthe cell tower 12), at the top of the cell tower 12 including pointingdown showing the entire cell site 10, etc. The photos for the sectorsshould capture all of the cell site equipment 14 including cabling,serial numbers, identifiers, etc.

For step 2706, the objective is to obtain photos inside the shelter orcabinet 52 to enable virtual movement through the interior and toidentify (zoom) items of interest. The photos capture all model numbers,labels, cables, etc. The model numbers and/or labels can be used tocreate hotspots in the virtual 360-degree view environment where theoperator can click for additional details such as close up views. Thedata capture should include photos with the equipment doors both openand closed to show equipment, status identifiers, cabling, etc. In thesame manner, the data capture should include any power plant, AC panels,batteries, etc. both with doors open and closed to show various detailstherein (breakers, labels, model numbers, etc.). Also, the data capturewithin the shelter or cabinet 52 can include coax ports and ground bars(inside/outside/tower), the telco board and equipment, all technologyequipment and model numbers; all rack-mounted equipment, all wallmounted equipment.

For ground-based photo or video capture, the method 2700 can use themultiple camera apparatus 2000 (or a variant thereof with a singlecamera such as a 360-degree camera). For example, the ground-based datacapture can use a tripod or pole about 4-7′ tall with a 360-degreecamera attached thereto to replicate an eye-level view for anindividual. A technician performing this data capture place theapparatus 2000 (or variant thereof) at all four corners of the cell site10 to capture the photos while then placing and capturing in between thepoints to make sure every perspective and side of objects can be seen ina 360/VR environment of the virtual 360-degree view environment.

Also, items needing additional detail for telecommunication audits canbe captured using a traditional camera and embedded into the 360/VRenvironment for viewing. For example, this can include detailed close-upphotos of equipment, cabling, breakers, etc. The individual taking thephotos places themselves in the environment where the camera cannot viewthem in that perspective.

For UAV-based data capture, the UAV 50 can include the 360-degree cameraattached thereto or mounted. Importantly, the camera on the UAV 50should be positioned so that the photos or video are free from the UAV,i.e., the camera's field of view should not include any portion of theUAV 50. The camera mount can attach below the UAV 50 making sure nolanding gear or other parts of the UAV 50 are visible to the camera. Thecamera mounts can be attached to the landing gear or in place of or onthe normal payload area best for the center of gravity. Using the UAV50, data capture can be taken systematically around the cell tower 12 tocreate a 360 view on sides and above the cell tower 12.

For step 2708, the 360-degree camera takes several photos of thesurrounding environment. The photos need to be combined into onepanoramic like photo by stitching the individual photos together. Thiscan be performed at the job site to stitch the photos together to makeit ready for the VR environment. Also, the various techniques describedherein are also contemplated for virtual views.

Once the virtual 360-degree view environment is created, it is hostedonline for access by operators, installers, engineers, etc. The virtual360-degree view environment can be accessed securely such as over HTTPS,over a Virtual Private Network (VPN), etc. The objective of the virtual360-degree view environment is to provide navigation in a manner similarto as if the viewer was physically located at the cell site 10. In thismanner, the display or GUI of the virtual 360-degree view environmentsupports navigation (e.g., via a mouse, scroll bar, touch screen, etc.)to allow the viewer to move about the cell site 10 and inspect/zoom inon various objects of interest.

FIGS. 44-55 illustrate screen shots from an example implementation ofthe virtual 360-degree view environment. FIG. 44 is a view entering thecell site 10 facing the cell tower 12 and the shelter or cabinet 52.Note, this is a 360-view, and the viewer can zoom, pan, scroll, etc. asif they were at the cell site 10 walking and/or moving their head/eyes.The display can include location items which denote a possible area theviewer can move to, such as the northwest corner or the back of shelterin FIG. 44. Further, the display can include information icons such astower plate which denotes the possibility of zooming in to seeadditional detail.

In FIG. 45, the viewer has moved to the back of the shelter, and thereare now information icons for the GPS antenna and the exterior coaxport. In FIG. 46, the viewer navigates to the top of the cell tower 12showing a view of the entire cell site 10. In FIG. 47, the viewer zoomsin, such as via an information icon, to get a closer view of one sector.In FIG. 48, the viewer navigates to the side of the shelter or cabinet52, and there is an information icon for the propane tank. In FIG. 49A,the viewer navigates to the front of the shelter or cabinet 52 showingdoors to the generator room and to the shelter itself along with variousinformation icons to display details on the door.

In FIG. 49B, the viewer navigates into the generator room, and this viewshows information icons for the generator. In FIG. 50, the viewernavigates into the shelter or cabinet 52 and views the wall showing thepower panel with associated information icons. In FIG. 51, the viewerlooks around the interior of the shelter or cabinet 52 showing racks ofequipment. In FIG. 52, the viewer looks at a rack with the equipmentdoor closed, and this view shows various information icons. Finally, inFIG. 53, the viewer virtually opens the door for LTE equipment.

FIGS. 54 and 55 illustrate the ability to “pop-up” or call an additionalphoto within the environment by clicking the information icons. Note,the viewer can also zoom within the environment and on the popped outphotos.

§ 24.0 Modified Virtual 360 View Systems and Methods

FIG. 56 is a flowchart of a virtual 360 view method 2800 for creating,modifying, and using a virtual 360 environment. The method 2800 includesperforming data capture of the telecommunications site (step 2802). Thedata capture can utilize the various techniques described herein. Ofnote, the data capture in the method 2800 can be performed prior toconstruction of the cell site 10, for planning, engineering, compliance,and installation. The entire construction area can be captured in aquick flight with the UAV 50. For example, the photos of the cell site10 or recommended construction zone can be captured with the UAV 50, ina manner that the environment can be reconstructed virtually into apoint cloud model using photogrammetry software.

Once the data capture is obtained, a 3D model is created based onprocessing the data capture (step 2804). The 3D model can be createdbased on the various techniques described herein. Again, the cell site10 here does not necessarily have the cell tower 12 and/or various cellsite components 14, etc. The objective of the method 2800 is to createthe 3D model where 3D replications of future installed equipment can beplaced and examined.

Once created from the data capture, the 3D model is exported andimported into modification software (step 2806). For example, the 3Dmodel can be exported using a file type/extension such as .obj withtexture files. The file and its textures are imported into a 3D designsoftware where 3D modifications can be performed to the imported 3Dmodel of already preexisting objects scanned and where new 3D objectscan be created from scratch using inputted dimensions or the like. Themodification software can be used to modify the 3D model to add one ormore objects (step 2808).

Specifically, the one or more objects can include the cell tower 12, thecell site components 14, the shelter or cabinet 52, or the like. Thatis, from the customer's specifications or construction drawings,equipment is added using their dimensions using the software. This canalso be performed using a GUI and drag/drop operations. The modificationsoftware can add/combine the newly created 3D objects to the cell siteor construction zone model at the correct distances from objects(georeferenced location) as illustrated in the construction drawings orclient details.

The model is then exported as a new 3D model file where it can be viewedby the customer in various 3D model software or web-based viewingpackages where the additions can be viewed from any perspective theychoose (step 2810).

The modified 3D model can be utilized for planning, engineering, and/orinstallation (step 2812). The 3D model in its future replicated form canthen be shared easily among contractors, engineers, and city officialsto exam the future installation in a 3D virtual environment where eachcan easily manipulate the environment to express their needs and come toa unified plan. This process will allow construction companies,engineers, and local official to see a scaled size rendering of theplans (i.e., CDs—Constructions Drawings).

FIGS. 57-58 are screenshots of a 3D model of a telecommunications site2850 of a building roof with antenna equipment 2852 added in themodified 3D model. Here, the antenna equipment 2852 is shown with afence on top of the building roof, showing the proposed construction isobscured. This can be used to show the building owner the actual look ofthe proposed construction in the modified 3D model as well as otherstakeholders to assist in planning (approvals, etc.) as well as toassist engineers in engineering and installation.

§ 25.0 Augmented Reality

The augmented reality systems and methods allow a user to experience 3Ddigital objects through a digital camera such as on a mobile device,tablet, laptop, etc. The 3D digital objects can be created viaphotogrammetry or created as a 3D model. The user can project the 3Ddigital objects onto in a virtual environment including real-time in aview on a phone, tablet, etc. as well as in existing virtualenvironments.

For example, the augmented reality systems and methods can be used in abattery and/or power plant installations such as in a cabinet orshelter. The augmented reality systems and methods can assist engineers,planners, installers, operators, etc. to visualize new equipment onsite, to determine where installation should occur, to determine cablelengths, to perform engineering, to show the operators options, etc. Theaugmented reality systems and methods can include visualizing rackplacements in shelters or head-end space for small cell applicationswith and without equipment already in the racks. The augmented realitysystems and methods can be used to visualize outdoor small cellequipment, cabinets, cages, poles, node placements, etc.

The augmented reality systems and methods can further be used for visualshelter and cell tower placements at new locations. Further, theaugmented reality systems and methods can visualize antenna placementson towers, walls, ceiling tiles, building, and other structures.Advantageously, the augmented reality systems and methods can be used toshow stakeholders (cell site operators, wireless service providers,building owners, the general public, etc.) the view prior toconstruction. Since the view is easily manipulable, the stakeholders canuse the augmented reality systems and methods to agree on project scopein advance, with very little cost for changes as there are all performedin the virtual environment. This can lead to easier project approval andgeneral satisfaction amongst the stakeholders.

FIG. 59 is a flowchart of a scanning method 2900 for incorporating anobject in a virtual view. The method 2900 enables the creation of a 3Dmodel of a virtual object which can then be placed in a virtualenvironment for augmented reality. As mentioned above, example use casesfor the virtual object can include a cell tower, a shelter, cell sitecomponents on the cell tower, power equipment, batteries, or virtuallyany component that is added to the cell site 10.

The method 2900 includes obtaining data capture and processing thecaptured data to create a 3D point cloud (step 2902). As describedherein, the data capture can use various different techniques includingthe UAV 50 and the associated aspects. The captured data can includephotos and/or digital video, with associated geographic information.

The method 2900 can include editing the 3D point cloud, generating a 3Dmesh of point, and editing the 3D mesh object if needed (step 2904). Theediting can be performed to adjust the capture data. Once the 3D meshobject is finalized, the method 2900 can include processing the 3D meshobject file (.obj) with material library files (.mtl) and texture filesto form a 3D model (step 2906). Steps 2902-2904 include the data captureand data processing to form the 3D model of the virtual object. Thevirtual object can be defined by the .obj file, mtl file, and texturefile together, such as in a folder or .zip file.

Next, the 3D model is incorporated in an augmented reality server (step2908). Here, the 3D model can be uploaded to the cloud for laterretrieval and use. Once on site or at a computer with a particular areaof interest in view, the method 2900 can include projecting the 3D modelof the virtual object in the area of interest (step 2910). In anembodiment, the mobile device 100 can include an augmented reality appwhich can be activated and use the camera. The augmented reality app canobtain a virtual object from the cloud and project it to scale in thecamera's field of view. In another embodiment, the virtual object can beadded to a virtual environment on a computer, etc. including one viewedvia a Web browser. Various other approaches are contemplated. Thisenables planners, installers, engineers, operators, etc. the ability toaccurately visualize the virtual object in place before it is installed.

FIG. 60 is a flowchart of a model creation method 2920 for incorporatinga virtually created object in a virtual view. The model creation method2920 is similar to the method 2900 except it involves creating thevirtual object without data capture. Here, a user can create 3D modelsusing 3D Computer Aided Design (CAD) software or the like. The user isable to either create a new prototype model based on need, or to reviewspec drawings of an existing object and create a 3D model based thereon.This will be able to provide the user a model, if it is not available toscan. For example, this may be the case in a new cell tower 12, etc.

The method 2920 includes creating a 3D model (step 2922). Again, thiscan be using 3D CAD software, etc. The 3D model is saved as a .obj fileor other 3D model file type. The .obj file can be included with the .mtlfile and texture file as above in the method 2900 and stored in thecloud. The method 2902 includes incorporating the 3D model in theaugmented reality server (step 2924) and on sire or with the particularare of interest in view, projecting the 3D model in the area of interest(step 2926).

§ 25.1 Augmented Reality with Equipment Add-in

The 3D model can include insertion of 3D models of currentlynon-existing equipment including, without limitation, radios, powerplants, batteries, Over Voltage Protection (OVP) equipment, 5G telecomequipment, antennas, Tower Mounted Antennas (TMAs), Remote Radio Head(RRH) equipment, and the like. The 3D model can include detailedspecifications of the added-in equipment such as dimensions, wattage,voltage, current, decibels, etc. These detailed specifications can bebrought up such as through a click or touch in the 360-degree view inthe 3D model. Advantageously, this can help engineers and planners withplanning for future equipment, upgrades, etc.

§ 25.2 Augmented Reality with Auto Detect Features

In an embodiment, the 3D model/360 degree view can auto detect (as wellas manual input) site equipment specifications (e.g., routers, switches,radios, cabinets, power plants, etc.) to determine, without limitation,power consumption, wattages of equipment, heating and air conditioningload, voltage, amperage, battery load, etc. The site equipmentspecifications can be obtained in a database and the equipment can bedetected by analyzing the 3D model/360 degree view to match theequipment, to detect serial numbers, etc.

This enables engineers and planners to virtually add equipment and todetermine if additional resources are needed (e.g., rectifier add, airconditioning, grounding, HVAC change, powerplant change (e.g., add −48Vbreakers, add more converters, etc.).

In addition to auto-detect of the site equipment specifications, thesystem implementing the 3D model/360 degree view can determine costs,pricing, and provide a Bill of Materials (BOM) for equipmentinstallations at the cell sites 10. The virtually installed equipmentcan be used to automatically generate the BOM (e.g., how many bolts,cabling, lengths of cables/coaxial cables/conduit/etc., mountinghardware kits, labor costs/times, etc. Also, the system can recommend orprovide labor quotes, etc. The system can provide valuable insight andengineering time reduction.

The system can include a configuration of the cell site 10, cell tower12, cell site components 14, etc. (antennas, radios, lines, jumpers,connectors, batteries, power plant, technologies, etc.). Thisconfiguration can be used when generating the BOM.

§ 26.0 Satellite Data Capture

FIG. 61 is a diagram of various satellites in orbit around the Earth foruse in data collection for the 3D model. FIG. 62 is a flowchart of a 3Dmodeling method 3000 for capturing data at the cell site, the celltower, etc. using one or more satellites. Various descriptions arepresented herein for the 3D model creation and use. For the 3D modelcreation, the various approaches include a data capture step which isperformed generally using the UAV 50, ground cameras, etc. In additionto these so-called terrestrial data capture techniques, the systems andmethods can also utilize satellite data capture—either by itself or incombination with the various techniques described herein. For example,in an embodiment, the satellite data capture can be used for exterior 3Dmodels of the cell site 10 whereas local data capture can be used forinteriors of the shelter or cabinet 52 equipment.

Advantageously, the satellite data capture can provide highly detailedphotographs and removes the requirement for site visits which is keygiven the number of cell sites. The 3D model can be used for variousfunctions related to planning, engineering, installation, and the like.In FIG. 61, there are various providers who have various satellites(e.g., constellations of satellites) which provide coverage of the U.S.for taking high-resolution photos. For example, the providers can havemultiple satellites in low-Earth orbit, each having a different angle,orientation, etc. to obtain data capture. For satellite data capture,the satellite provider is given a location of the cell site 10 (e.g.,GPS coordinates) and the satellite provider programs the varioussatellites to obtain various pictures to cover the cell site 10, thecell tower 12, and the cell site components 14. For example, use ofdifferent satellites in the constellation provides the samefunctionality of the UAV 50 orbiting the cell tower 12. That is, eachsatellite has a different orbit and can capture a different view of thecell site 10. i.e., a different side of the cell tower 12.

One advantage of the satellite data capture is the time savings andlabor savings. Again, as described herein, there are hundreds ofthousands of cell sites 10 in the U.S. Obtaining the data capture forthe cell site 10 from a satellite provider significantly improves thespeed and cost of the data capture. Further, the process of capturingdata can be done in batches such that each pass of a satellite (a passbeing a trajectory over the U.S.) can capture multiple cell sites 10along the way that are in its trajectory. This approach can reduce thetime and cost of the satellite usage.

In FIG. 62, the method 3000 includes providing a location of a cell siteto one or more satellites (step 3002); receiving data capture from theone or more satellites with the data capture comprising photos or videosof a cell tower and cell site components at the cell site (step 3004);and processing the data capture to define a three dimensional (3D) modelof the cell site based on one or more objects of interest in the datacapture (step 3006). The method 3000 can further include remotelyperforming a site survey of the cell site utilizing a Graphical UserInterface (GUI) of the 3D model to collect and obtain information aboutthe cell site, the cell tower, one or more buildings, and interiorsthereof (step 3008).

The site survey can include a determination of a down tilt angle of oneor more antennas of the cell site components based on measuring threepoints comprising two defined by each antenna and one by an associatedsupport bar using the 3D model, plumb of the cell tower and/or the oneor more antennas, azimuth of the one or more antennas using a locationin the 3D model, dimensions of the cell site components, equipment typeand serial number of the cell site components, connections between thecell site components, a status of a lightning rod and warning light onthe cell tower, and Global Positioning Satellite (GPS) coordinates. Theremotely performing the site survey can include determining equipmentlocation on the cell tower; measuring distances between the equipmentand within the equipment to determine actual spatial location; anddetermining connectivity between the equipment based on associatedcabling.

The one or more satellites can include a plurality of satellites eachwith a different angle or orientation for the associated photos orvideos. The processing can include stitching the associated photos orvideos together to create a 3D point cloud for the 3D model. The method3000 can further include remotely performing one or more of planning,engineering, and installation associated with the telecommunicationssite utilizing the 3D model (step 3010).

§ 27.0 Telescoping Apparatus for Data Capture

FIG. 63 is a perspective diagram of a mobile unit 3102 with atelescoping apparatus 3100 for data capture in a transport position.FIG. 64 is a perspective diagram of the mobile unit 3102 with thetelescoping apparatus 3100 in the process of raising in an operatingposition. FIG. 65 is a perspective diagram of the telescoping apparatus3100 in a mobile configuration to maneuver at the cell site 10. FIG. 66is a perspective diagram of the telescoping apparatus 3100 with ascissor lift mechanism.

The telescoping apparatus 3100 includes a telescoping pole 3110 and acamera 3120 at an end of the telescoping pole 3110. The telescoping pole3110 can extend a couple hundred feet to support heights up to the topof the cell tower 12. For example, about 80% of cell sites 10 aremonopoles and about 85% of these are 150′ or less. Thus, the telescopingpole 3110 can be about 150′ or less and support the vast majority ofcell sites 10.

The telescoping pole 3110 is extended by an extension mechanism 3122which can include any mechanical technique to raise/lower thetelescoping pole 3110, such as a motor, a hydraulic motor, an electricmotor, a gas powered motor, various gears, etc. Also, the telescopingpole 3110 can be a scissors lift 3124.

The mobile unit 3102 is illustrated with the telescoping apparatus 3100integrated on a bed 3130 of a truck or the like. The truck can be aflatbed, semi-trailer, or full trailer. The mobile unit 3102 includes acab 3132 for a driver and an engine or the like. The bed 3130 isattached or connected to the cab 3132. In the transport position, thetelescoping platform 3100 can be tens of feet, capable of beingtransported on roads and highways and can be supported by a support 3134located on the bed 3130. The telescoping pole 3110 can be locked to thesupport 3134 in the transport position.

The telescoping pole 3110 includes N sections each of M feet, therebysupporting heights of N×M. In an embodiment, each section is 20′ andthere are ten sections for 200′ height. Other embodiments are alsocontemplated. The size of the M feet can be based on the mobile unit 102and considerations associated with transport on road and highways.

Alternatively, the telescoping apparatus 3100 can be part of a trailerwhich is hitched to another vehicle. In yet another embodiment, thetelescoping platform 3100 can be mobile itself with wheels andpropulsion. In a further embodiment, the telescoping platform 3100 canbe part of or made with a crane. Various other embodiments are alsocontemplated.

The mobile unit 3102 is configured to drive on roads, highways, gravel,etc. to bring the telescoping platform 3100 to a location proximate tothe cell tower 12. Once the mobile unit 3102 is positioned proximate tothe cell tower 12, the telescoping apparatus 3100 is configured todeploy. To deploy the telescoping platform 3100 from the transportposition to the operating position, first, the telescoping pole 3110 isunlocked from the support 3134. Next, the telescoping pole 3110 with theplatform 3120 is raised from a lateral, horizontal position to avertical position. This movement can be through the extension mechanism3122. Specifically, the extension mechanism 3122 can rotate thetelescoping platform 3100 about ninety degrees from the transportposition to the operating position as well as extend each of the Nsections of the telescoping pole 3110 vertically to raise or lower theplatform 3120.

In an embodiment, a telescoping apparatus 3100 for data capture of acell tower 12 includes a telescoping pole 3110 adapted to selectivelyextend vertically via an extension mechanism 3122; a platform 3120disposed to a top of the telescoping pole 3110 and adapted to support acamera 3120 for taking pictures of the cell tower 12. The telescopingpole 3110 can include N sections each with a length M to provide anextension of the platform to a height of about N×M, wherein N and M areselected based on the one of a bed 3130 and a trailer and a desiredheight for the cell tower 12. The telescoping pole 3110 and the platform3120 are configured in a transport position substantially horizontal andan operating position substantially vertical.

In a further embodiment, a mobile unit 3102 with a telescoping platform3100 for data capture of a cell tower 12 includes one of a bed 3130 anda trailer; a telescoping pole 3110 on the one of the bed 3130 and thetrailer, wherein the telescoping pole 3110 is adapted to selectivelyextend vertically via an extension mechanism 3122; a camera 3120disposed to a top of the telescoping pole 3110.

FIG. 65 illustrates the telescoping apparatus 100 in a mobileconfiguration to maneuver at the cell site 10. Specifically, in thisembodiment, the telescoping apparatus 100 includes wheels 3160 such thatthe telescoping apparatus 3100 can maneuver in tight spaces, overgravel, etc. such that it is positioned proximate to the cell tower 12.Here, the telescoping apparatus 3100 can be brought to the cell site 10via the mobile unit 3102, offloaded and then moved to the cell tower 12.

In an embodiment, the extension mechanism 3122 can include a motor orthe like to drive the wheels 3160. The telescoping apparatus 3100 can becontrolled via a remote, via a driver, via a mobile device, etc. Inanother embodiment, the telescoping apparatus 3100 can be pulled by anAll-Terrain Vehicle (ATV), a truck, etc. Of note, a crane hasdifficulties accessing the cell tower 12 based on current deploymentpractices, i.e., cell towers 12 are deployed typically around trees,with a narrow gravel ingress road, etc. The objective here is for thetelescoping apparatus 3100 to maneuver to the cell tower 12 vertically.It is expected that it would be difficult to bring a large truck to thecell tower 12 as well as associated risks.

The telescoping apparatus 3100 can also include stabilizing arms 3162and wheels 3164 that can be selectively extended or removed to providestabilization as the telescoping apparatus 3100 is maneuvered to thecell tower 12. The stabilizing arms 3162 and wheels 3164 ensure thetelescoping apparatus 3100 does not topple over as it stands verticallyduring maneuvering. The stabilizing arms 3162 and wheels 3164 can bestored or removed in the transport position.

In another embodiment, the telescoping apparatus 3100 can have thewheels on the telescoping pole 3110 allowing the telescoping platform3100 to maneuver in the transport position, i.e., the telescoping pole3110 is horizontal. Here, the extension mechanism 3122 can rotate thetelescoping pole 3110 once the telescoping apparatus 3100 is in thedesired position. The wheels on the telescoping pole 3110 can be removedor remain in place in the operating position.

§ 28.0 Closing Out Maintenance or Installation Work

FIG. 67 is a flowchart of a method 3200 for closing out maintenance orinstallation work at a telecommunication site. Again, a close outpackage (COP) is a document or set of documents which verify anddocument maintenance and/or installation work at a telecommunicationsite such as the cell site 10. The various aspects described herein canbe used to obtain data for the close out package. The close out packagecan be a file or other type of electronic document which can be hostedon a server, in the cloud, etc. The close out package can be deliveredto a customer via a URL link such as through an email, via a website,embedded in a document (i.e., a spreadsheet, word processor document,etc.), etc. Also, the close out package can be included in a website, aswell as with a link to a viewing software. The close out package can behosted on a third-party server, in-house corporate servers, offsite, inthe cloud, etc.

The close out package can be viewed, analyzed, etc. to view the currentstatus of the cell site 10, cell tower 12, etc. The close out packagecan include a 3D model as described herein. Personnel can use the closeout packet for pre/post-installation of the cell site 10. The views/3Dmodel can be used to determine the scope of work performed.

The method 3200 includes, subsequent to the work, performing datacapture at the telecommunications site through a plurality of techniques(step 3202); processing the data capture to define a three dimensional(3D) model of the telecommunications site based on one or more objectsof interest associated with the cell site components and noting the workin the 3D model (step 3204); and incorporating the 3D model in a closeout package and providing the close out package to one or more users(step 3206). The close out package can be hosted on a cloud-based serverand the providing comprises one of sending an email, website log in, ora link directed to the close out package. The data capture can includephotos or video of the telecommunications site and the work performedthere, including a cell tower and cell site components on the celltower. The 3D model can include a plurality of two-dimensional (2D)photos embedded therein and viewable via clicking or selecting in the 3Dmodel.

The plurality of techniques for the data capture can include the use ofan Unmanned Aerial Vehicle (UAV). The plurality of techniques for thedata capture can include the use of a satellite. The plurality oftechniques for the data capture can include the use of a telescopingpole. The method 3200 can further include utilizing the close out packetfor a determination of a down tilt angle of one or more antennas of thecell site components based on measuring three points comprising twodefined by each antenna and one by an associated support bar using the3D model, plumb of the cell tower and/or the one or more antennas,azimuth of the one or more antennas using a location in the 3D model,dimensions of the cell site components, equipment type and serial numberof the cell site components, connections between the cell sitecomponents, a status of a lightning rod and warning light on the celltower, and Global Positioning Satellite (GPS) coordinates.

§ 29.0 Obtaining 3D Modeling Data View Intelligent Flight Modes

As described herein, the UAV 50 can be used to obtain data capture forvarious aspects including the creation of the 3D model. In anembodiment, the UAV 50 can take off towards the top of the cell tower12. Once at the top of the cell tower 12, the camera 86 is pointedstraight down for a top-down view of the cell site 10 and cell tower12—this is performed to ensure the UAV 50 is directly below the celltower 12. A Point of Interest (POI) flight mode is started and the GPScoordinate/altitude data is collected at the top of the cell tower 12.Here, the cell tower 12 is the POI and the cell tower 12 is usually atthe center of the cell site 10.

The UAV 50 starts increasing altitude and widening the radius away fromthe cell tower 12. A speed is selected that allows the camera 86 a photoshuttering time for at least a 75% photo overlap. The flight will thentake place autonomously. By increasing the radius and altitude, the UAV50 can be used to create an overall view of the cell site 10 for the 3Dmodel. The altitude and radius can be adjusted while the flight ispaused or during the flight. By changing the altitude and radius, theUAV 50 can take inspection photos around each RAD center and other partsof the tower/compound. These photos can be added for the modelingprocess. By using intelligent flight modes, the UAV 50 can decrease thenumber of flights, use fewer batteries, and decrease the amount of timespent at the cell site 10.

§ 30.0 Augmented Reality Add-in Process

FIG. 68 is a flowchart of a method 3300 for creating a 3D model of atelecommunications site and performing an augmented reality add-in ofequipment, structures, etc. at the telecommunications site. The method3300 includes obtaining data capture of the telecommunications siteutilizing a plurality of an Unmanned Aerial Vehicle (UAV), a satellite,a multiple camera apparatus, and a telescoping apparatus (step 3302);creating the 3D model utilizing the data capture (step 3304); insertingcurrently non-existing equipment or structures in the 3D model (step3306); and performing engineering and planning for thetelecommunications site utilizing the 3D model with the insertedcurrently non-existing equipment (step 3308).

The non-existing equipment or structures can include one or more ofradios, power plants, batteries, Over Voltage Protection (OVP)equipment, 5G telecom equipment, antennas, Tower Mounted Antennas(TMAs), and Remote Radio Head (RRH) equipment. The method 3300 canfurther include determining specifications of the non-existing equipmentor structures and incorporating the specifications in the 3D model; andcausing display of one or more of the specifications based on aselection in the 3D model. The specifications can include a plurality ofdimensions, wattage, voltage, current, cost, and decibels.

The method 3300 can further include determining a necessary change tothe telecommunications site based on the specifications of the insertednon-existing equipment or structures. The method 3300 can furtherinclude determining a Bill of Materials (BOM) for a plurality of typesof the non-existing equipment or structures; and providing a listing ofa specific BOM based on the inserted non-existing equipment orstructures. The method 3300 can further include utilizing the 3D modelfor site planning and engineering for a change in the telecommunicationssite.

§ 31.0 Uploading of Site Audit and 3D Model Documents

The 3D model, close out audit package, etc. is a data package thatdescribes the cell site 10. A typical process involves the creation ofthis data package by an engineer, installer, planner, etc. and they maybe from a separate organization from a consumer (user). For example, thedata package may be prepared by an engineering company or department andthe user who needs the data package may be at another organization suchas an owner/operator of the cell site 10. There is a need for a processto provide the data package between these users.

FIG. 69 is a method 3400 for a workflow to share the data package withan end user. The method 3400 includes login (step 3402), upload (step3404), search and screenshot (step 3406), disconnect (step 3408), andemail (step 3410).

The login can be via a Web browser, an application, etc. utilizing aVirtual Private Network, Hypertext Transfer Protocol Secure (HTTPS),etc. Once logged in, a User Interface (UI) can be provided for theupload. The upload can include data entry/selection such as for vendor,location, document type, upload files, etc.

The UI can also provide a search and screenshot for the user to searchfor documents such as by title, location, vendor, document type, etc.FIG. 70 is a screenshot of the UI. The email can be used to notify oneor more users of the uploaded data package and they can log in andretrieve/view the data.

A method for preparing and delivering a data package detailing workperformed at a telecommunications site includes, subsequent to the work,performing data capture at the telecommunications site utilizing aplurality of an Unmanned Aerial Vehicle (UAV), a satellite, a multiplecamera apparatus, and a telescoping apparatus; processing the datacapture to provide a close out audit package for the telecommunicationssite describing the work; uploading the close out audit package througha User Interface to a server; providing the close out audit package toone or more users via the server; and performing verification of thework via the uploaded close out audit package. The method can furtherinclude processing the data capture to define a three dimensional (3D)model of the telecommunications site based on one or more objects ofinterest associated with the cell site components and noting the work inthe 3D model; and incorporating the 3D model in the close out auditpackage.

The close out audit package can be hosted on a cloud-based server andthe providing comprises one of sending an email, website log in, or alink directed to the close out package. The data capture includes photosor video of the telecommunications site and the work performed there,including a cell tower and cell site components on the cell tower. The3D model can include a plurality of two-dimensional (2D) photos embeddedtherein and viewable via clicking or selecting in the 3D model. The datacapture can include use of the UAV.

The method can further include utilizing the close out packet for adetermination of a down tilt angle of one or more antennas of the cellsite components based on measuring three points comprising two definedby each antenna and one by an associated support bar using the 3D model,plumb of the cell tower and/or the one or more antennas, azimuth of theone or more antennas using a location in the 3D model, dimensions of thecell site components, equipment type and serial number of the cell sitecomponents, connections between the cell site components, a status of alightning rod and warning light on the cell tower, and GlobalPositioning Satellite (GPS) coordinates.

∫ 32.0 PIM Mitigation Audit

FIG. 71 is a flowchart of a method 3500 for performing a PIM mitigationaudit. Again, PIM impacts performance of a cell site 10. Theconventional approach is to perform PIM testing on-site. The presentdisclosure includes the PIM mitigation audit which can be performedprior to on-site physical PIM testing to identify the cell sites 10 thatare more likely to have PIM issues. As such, the physical on-sitetesting can be optimized to the cell sites 10 that are more likely tohave PIM issues, as opposed to testing every cell site 10 which isinefficient, time-consuming, costly, etc. Again, the PIM mitigationaudit can be performed based on various measurements that can beobtained via data capture through an Unmanned Aerial Vehicle (UAV)(“drones”), satellite data capture, plane data capture, ground-baseddata capture, etc. along with a three-dimensional (3D) model. That is,the PIM mitigation audit contemplates all of the various data capturetechniques described herein along with the use of the 3D modelingdescribed herein.

Specifically, the present disclosure includes a method, an apparatus,and instructions embodied in a non-transitory computer-readable mediumto perform various measurements to determine PIM likelihood. In anembodiment, the present disclosure utilizes a 3D model. For example, thepresent disclosure can create an antenna mount detail to perform variousmeasurements such as, for example:

Measurements between existing antennas Measurements between existingantennas and other equipment installed (Remote Radio Head (RRH), radio,Tower Mounted Amplifier (TMA) or filters) Measurement between antennasand adjacent sectors Centerline confirmation Measurements of existingpipe mounts Measurement of existing antenna platform Verticalmeasurements above and below existing installed equipment Sector faceazimuths or skew angle

These various measurements can provide indications of potential for PIMissues.

Additionally, the present disclosure can determine, for example:

Line of sight viewpoint at rad center at each sector of the cell tower12 Identification of line of sight obstacles Sector labeled photosincluding compass showing North direction

Additionally, the present disclosure can determine issues arising fromarise from antenna placement (i.e., an antenna out in front of anadjacent antenna and creating signal issues). Also, the audit can locatestray (not design) metal in front of the antenna radiation path. Withrespect to the measurements, the audit is to measure the distancebetween antennas (side to side, above, below, and antenna to buildingparapet).

The data capture can use any of the aforementioned techniques describedherein. Also, the data capture can include photos/video of existingantenna installations with compound and property view. The presentdisclosure can both utilize the 3D model and provide details in the 3Dmodel of potential PIM issues/locations. This can include the compoundand ground based installed equipment, a ground equipment photo package,a detailed compound layout plan, and a detailed equipment room layoutplan.

The method 3500 includes obtaining data capture at a cell site utilizingany of an Unmanned Aerial Vehicle (UAV), a satellite, a multiple cameraapparatus, a telescoping apparatus, and a camera (step 3502); creating amodel of the cell site based on the data capture (step 3504); processingthe model to perform a plurality of measurements (step 3506); utilizingthe plurality of measurements to identify potential PassiveIntermodulation (PIM) issues at the cell site (step 3508); anddisplaying the identified PIM issues for mitigation thereof (step 3510).

The model can be a three dimensional (3D) model of the cell site basedon one or more objects of interest associated with the cell sitecomponents. The data capture can be based on photos and/or video fromthe UAV. The cell site can be a first cell site, and the method 3500 canfurther include obtaining data capture for a plurality of cell sites;and performing the creating, the processing, the utilizing, and thedisplaying for the plurality of cell sites. The method 3500 can furtherinclude ranking the first cell site and the plurality of cell sitesbased on the PIM issues. The mitigation can include physical on-sitetesting based on the ranking. The measurements can include a pluralityof measurements between existing antennas, measurements between existingantennas and other equipment installed, measurements between antennasand adjacent sectors, centerline confirmation, measurements of existingpipe mounts, measurement of existing antenna platform, verticalmeasurements above and below installed equipment, and sector faceazimuths or skew angle.

§ 33.0 360 Degree Camera Apparatus and Methods for Monitoring CommercialSites

FIG. 72 is a perspective diagram of a monitoring system 7210. Themonitoring system includes a 360 degree camera apparatus 7220 mounted ona structure 7290. The 360 degree camera apparatus 7220 is adapted tostream a 360 degree view of a commercial location, such as atelecommunications site. In the embodiment illustrated, the 360 degreecamera apparatus 7220 includes a base 7222 and sensors 7226.

The base 7222 is adapted to mount the 360 degree camera apparatus 7220to the structure 7290. The structure 7290 can be any structure at thecommercial site, such as building or other enclosure, such as a shelteror a cabinet, outside of the enclosure, a cell tower, parking lot,battery location, generator, other general areas, and the like. In theembodiment illustrated, the 360 degree camera is mounted to the interiorceiling 7200 of a building. However, other mounting locations, such asthe floor, walls, shelves, a dedicated support structure, and the likeare also contemplated. In some embodiments, the base includes anactuator 7224. The actuator 7224 is adapted to change one or more of anorientation and a position of the sensors 7226, such as by translating,rotating, or tilting the base 7222. In some embodiments, the 360 degreecamera apparatus 7220 is a retractable unit and the actuator 7224 isadapted to retract the 360 degree camera apparatus while the 360 degreecamera apparatus is not in use.

In some embodiments, the monitoring system 7210 includes a track or asimilar mechanism that is adapted to move the 360 degree cameraapparatus 7220 along the surface that the track/360 degree cameraapparatus 7220 is mounted to. Such movement facilitates the capture ofimages and other data, as described in further detail below, frommultiple positions within the selected location of the 360 degree cameraapparatus 7220.

The sensors 7226 include at least one array of image sensors adapted tocapture a 360 degree view around the 360 degree camera apparatus 7220.In one embodiment, this array of image sensors is arranged tosimultaneously capture a combined 360 view around the camera apparatus,such as by being arranged in a circular patterns. In another embodiment,the array of image sensors is arranged with further image sensors withinthe circular pattern or in a hemispherical pattern for capturing the 360view, along with views oriented transverse to the views associated withthe 360 degree views, such as an outwardly facing and overlappinghemispherical pattern of views with the 360 degree view around thecamera apparatus forming the base of the hemispherical pattern. In someembodiments, the field of views for adjacent image sensors overlap. The360 degree camera apparatus 7220 is configured to provide a 360 degreeview of a commercial space by providing a plurality of images, that areconstantly streaming, to a user for viewing in real time. These imagescan be taken on a regular interval, can be provided in a video format,and the like. The monitoring system 7210 is configured to allow a userto select which of the image sensors 7226 from the sensors 7226 the useris viewing, such as by allowing the user to scroll between views in aclockwise or counter-clockwise direction, displaying multiple imagessimultaneously, stitching multiple views together, and the like. Thedisplaying, stitching, and the like can be performed by the cameraapparatus 7220 or the server 7280

In embodiments, each of the image sensors is paired with a lens forenhancing the views available view the image sensors. The lenses caninclude a wide lenses, fish-eye lenses, telescoping lenses, and thelike.

In some embodiments, the sensors 7226 include any combination of light,infrared, sound, motion, and RF sensors. Light sensors, such as Lidar,are configured to perform measurements of equipment, empty spaces, andthe like. Infrared sensors are configured to obtain thermographic imagesand data within at least the 360 degree view of the one or more arraysof sensors 2226, such as for monitoring the operating temperatures ofequipment. Sound sensors are configured to at least one of communicationwith individuals at the site and for monitoring the equipment, such asby listening for certain sounds (or lack thereof) indicative ofequipment trouble or failure. Motion sensors, in combination with theimage sensors, are configured to detect unauthorized access to thecommercial location/telecommunications site, while the RF sensors areconfigured to measure wireless signals associates with cell sitecomponents for monitoring the wireless signals.

In some embodiments, the monitoring system 7210 includes multiple 360degree camera apparatuses 7220 to capture a more comprehensive view ofthe commercial location. In one embodiment, a 360 degree cameraapparatus is positioned on opposing sides of a structure, such as a wallof a building, a door, a support beam of a cell tower, and the like. Inthese embodiments, another array of image sensors, extending across aface of the camera apparatus 7220 is adapted to capture a 180 degreeview of a commercial space. By positioning a 360 degree camera on eachside of a structure, a 360 view (such as both outside and inside of thestructure above and below a support beam, and the like), transverse tothe structure, is obtainable, such as by combining two 180 degree viewstogether from each side of the structure.

In the embodiment illustrated, the monitoring system 7210 also includesa server 7280. The server 7280 is configured to facilitate remote accessto the 360 degree camera apparatus 7220 including access to the outputsof the sensor, including viewing the images therefrom, and the like.Further access can include access to archived data, such data capturedduring an event, such as images captured during the event, historicaldata related to previously triggered alarms, and the like. Access can beattained via user login credentials, a URL, and the like.

In some embodiments, the server 7280 is configured to use data capturedfrom the sensors 7226 to generate a 3D model. Any of the methodsdisclosed herein can be used to generate the model. Furthermore, thedata capture from the sensors 7226 can be combined with the data capturefrom other instruments, such a UAV, a satellite, a multiple cameraapparatus, a telescoping apparatus, and other cameras and systems, asdisclosed herein, to generate a comprehensive model of a commercialsite, such as a telecommunications site.

In some embodiments, the monitoring system 7210 is configured to providean augmented reality view of the images. In these embodiments, theserver 7280 utilizes information from the 3D model to overlay theinformation in the live images being displayed and streamed from theimage sensors. One or more of measurements, dimensions of equipment,labels of the equipment, and the like, are displayed within the imagesbeing displayed and streamed to the user. Furthermore, data captured inreal time from the other sensors, such as current temperatures ofequipment, decibel levels, and the like are also displayed. Inembodiments, which information is being displayed with the images isselectable from a user interface. In embodiments, virtual objects, suchas those described above, are insertable into the images being displayedenabling a user to determine whether an object, such as equipment forthe commercial location, properly fit within a given space.

In some embodiments, the monitoring system 7210 also connects to theequipment to obtain voltage draw of the equipment, and the like. In someembodiments, the voltage draw, current power consumption, and the likeare also displayed in the images.

With the augmented reality view available in a 360 view of a selectedlocation at a commercial site, a user has the ability to switch betweenviews from multiple cameras and can obtain different windows of data,such as space considerations, Rack unit availability, coaxial portavailability, power considerations, temperature zoning, and the like,without a visit to the facility.

Further, the 3D model of the location can be updated on demand andwithout requiring a further visit to the site, which ensures that anysite planning and engineering is being made based on currentinformation. In embodiments, upon updating the 3D model, the updatedversion of the 3D model is compared to the previous version of the 3Dmodel and changes to the site are highlighted and identified in thecomparison.

In some embodiments, the monitoring system 7210 is configured to monitorthe commercial location, and in particular, the equipment at thecommercial location. The monitoring system 7210 is configured to obtaindata from the sensors 7226 including images from the imaging sensors. Inembodiments, the monitoring system is also configured to obtain datafrom one or more of decibel measurements from the sound sensors,temperature measurements from the infrared sensors, radio frequencymeasurements from the RF sensors, and the like. These measurements arecompared to threshold values, such as a maximum decibel value, a maximumtemperature value (generally or individually for each piece ofequipment), a minimum or maximum voltage draw or power level of theequipment, and the like.

Upon detecting measurements that cross the threshold value (measurementsabove a maximum value or measurements below a minimum value), an alarmis generated and provided to a site administrator, such as an owner ofthe commercial space and an operator of the equipment. The alarm can beprovided via one or more of text message, email, a push notification toan application, and the like. The message can include the relevantinformation, a link to directly access the 360 degree camera apparatus7220, and the like. In some embodiments, the message includes one ormore of images captured at the time of the alarm, thermal imagescaptured at the time of the alarm, sounds recorded at the time of thealarm, voltage draw of the equipment, power levels of the equipment andthe like.

In some embodiments, the 360 degree camera apparatus 7220 includes oneor more speakers that allows the user, such as the site administrator,to converse with a person on site, such as a person at the site toaddress an alarm, and the like.

In some embodiments, multiple 360 degree camera apparatuses 7220 aregrouped together. In some embodiments, these groupings are one of 360degree camera apparatuses 7220 located at the same commercial site, suchas at the same telecommunications site, and located within a network ofcommercial sites, such a Centralized Radio Access Network (“CRAN”) orMobile Switching Center (“MSC”), a switch, hotspots, and the like.

In embodiments, each of the multiple 360 degree camera apparatuses 7220in the group are displayed on a map, such as a city map and a floor planof a building, with an icon where each icon is selectable for viewingimages, the 3D model, data collected by the sensors 7226, past datacollected by the sensors, active alarms, previously triggered alarms,and the like. In embodiments, any current alarms are displayed with theicons, such as by adding a second icon or modifying the icon, such as acolor, a pulsing display of the icon, and the like within the map.

In embodiments, each of the other of the 360 degree camera apparatuses7220, is represented by an icon, such as a dot, in a respective image ofthe 360 degree view of images where the corresponding 360 degree cameraapparatus 7220 falls in a general direction of the field of view of theimage sensor or within a respective image with a general direction ofthe field of view is in a direction closest to a direction of thecorresponding 360 degree camera apparatus 7220 relative to the 360degree camera apparatus 7220 being viewed. In some embodiments, theicons for other 360 degree camera apparatuses 7220 at a same commercialsite as the 360 degree camera apparatus 7220 being viewed are differentthan the icons for other 360 degree camera apparatuses 7220 that arelocated at a different commercial site as the 360 degree cameraapparatus 7220 being viewed.

FIG. 73 is a side perspective diagram of a cell tower 7300 with 360degree camera apparatuses 7220 mounted thereon. In the embodimentillustrated, the 360 degree camera apparatuses 7220 are mounted on astructural beam 7302 of the cell tower 7300 and are centrally located.However, the 360 degree camera apparatuses 7220 can be positioned inother locations, such as at a top of the tower, near the bottom of thetower, and the like.

In the embodiment illustrated, a first 360 degree camera apparatus 7220is arranged towards the sky and is configured for viewing the equipment7310 positioned above the first 360 degree camera apparatus 7220, whilea second 360 degree camera 7220 is arranged towards the ground and isconfigured for viewing the equipment 7310 positioned below the second360 degree camera apparatus 7220. In embodiments, one or more of the 360degree camera apparatuses 7220 include barometers, and the like, formeasuring the atmospheric pressure and the weather.

FIG. 74 is a block diagram of a 360 degree camera apparatuses 7220,which may be used with the monitoring system 7210. Specifically, the 360degree camera apparatuses 7220 includes a processor 7252, I/O interfaces7254, a network interface 7256, a data store 7258, and memory 7260. Itshould be appreciated by those of ordinary skill in the art that FIG. 74depicts the 360 degree camera apparatuses 7220 in an oversimplifiedmanner, and a practical embodiment may include additional components andsuitably configured processing logic to support known or conventionaloperating features that are not described in detail herein. Thecomponents (7252, 7254, 7256, 7258, and 7220) are communicativelycoupled via a local interface 7262. The local interface 7262 can be, forexample, but not limited to, one or more buses or other wired orwireless connections, as is known in the art. The local interface 7262can have additional elements, which are omitted for simplicity, such ascontrollers, buffers (caches), drivers, repeaters, and receivers, amongmany others, to enable communications. Further, the local interface 7262may include address, control, and/or data connections to enableappropriate communications among the aforementioned components.

The processor 7252 is a hardware device for executing softwareinstructions. The processor 7252 can be any custom made or commerciallyavailable processor, a CPU, an auxiliary processor among severalprocessors associated with the 360 degree camera apparatuses 7220, asemiconductor-based microprocessor (in the form of a microchip orchipset), or generally any device for executing software instructions.When the 360 degree camera apparatuses 7220 is in operation, theprocessor 7252 is configured to execute software stored within thememory 7260, to communicate data to and from the memory 7260, and togenerally control operations of the 360 degree camera apparatuses 7220pursuant to the software instructions. In an embodiment, the processor7252 may include a mobile-optimized processor such as optimized forpower consumption and mobile applications. The I/O interfaces 7254 canbe used to receive user input from and/or for providing system output.User input can be provided via, for example, a keypad, a touch screen, ascroll ball, a scroll bar, buttons, a barcode scanner, and the like.System output can be provided via a display device such as a LiquidCrystal Display (LCD), touch screen, and the like.

The network interface 7256 enables communication to an external accessdevice or network, such as via wired and wireless communication. Anynumber of suitable communication protocols, techniques, or methodologiescan be supported by the network interface 7256, including any protocolsfor wireless communication. The data store 7258 may be used to storedata. The data store 7258 may include any of volatile memory elements(e.g., random access memory (RAM, such as DRAM, SRAM, SDRAM, and thelike)), nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM,and the like), and combinations thereof. Moreover, the data store 308may incorporate electronic, magnetic, optical, and/or other types ofstorage media.

The memory 7260 may include any of volatile memory elements (e.g.,random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)),nonvolatile memory elements (e.g., ROM, hard drive, etc.), andcombinations thereof. Moreover, the memory 7260 may incorporateelectronic, magnetic, optical, and/or other types of storage media. Notethat the memory 7260 may have a distributed architecture, where variouscomponents are situated remotely from one another, but can be accessedby the processor 7252. The software in memory 7260 can include one ormore software programs, each of which includes an ordered listing ofexecutable instructions for implementing logical functions. For example,the software in the memory 7260 includes a suitable operating system7264 and programs 7266. The operating system 7264 essentially controlsthe execution of other computer programs and provides scheduling,input-output control, file and data management, memory management, andcommunication control and related services. The programs 7266 mayinclude various applications, add-ons, etc. configured to provideend-user functionality with the 360 degree camera apparatuses 7220. Forexample, example programs 7266 may include, but not limited to, imagecapture and display, data capture and display, and the like. In atypical example, the end-user typically uses one or more of the programs7266 over a network.

FIG. 75 is a block diagram of a server 7290, which may be used in themonitoring system 7210. The server 7290 may be a digital computer that,in terms of hardware architecture, generally includes a processor 7292,input/output (I/O) interfaces 7294, a network interface 7296, a datastore 7298, and memory 7280. It should be appreciated by those ofordinary skill in the art that FIG. 75 depicts the server 7290 in anoversimplified manner, and a practical embodiment may include additionalcomponents and suitably configured processing logic to support known orconventional operating features that are not described in detail herein.The components (7292, 7294, 7296, 7298, and 7280) are communicativelycoupled via a local interface 7282. The local interface 7282 may be, forexample, but not limited to, one or more buses or other wired orwireless connections, as is known in the art. The local interface 7282may have additional elements, which are omitted for simplicity, such ascontrollers, buffers (caches), drivers, repeaters, and receivers, amongmany others, to enable communications. Further, the local interface 7282may include address, control, and/or data connections to enableappropriate communications among the aforementioned components.

The processor 7292 is a hardware device for executing softwareinstructions. The processor 7292 may be any custom made or commerciallyavailable processor, a Central Processing Unit (CPU), an auxiliaryprocessor among several processors associated with the server 7290, asemiconductor-based microprocessor (in the form of a microchip orchipset), or generally any device for executing software instructions.When the server 7290 is in operation, the processor 7292 is configuredto execute software stored within the memory 7280, to communicate datato and from the memory 7280, and to generally control operations of theserver 7280 pursuant to the software instructions. The I/O interfaces7294 may be used to receive user input from and/or for providing systemoutput to one or more devices or components.

The network interface 7296 may be used to enable the server 7290 tocommunicate on a network, such as the Internet with one or more 360degree camera apparatuses 7210, user devices, and the like. The networkinterface 7296 may include, for example, an Ethernet card or adapter ora Wireless Local Area Network (WLAN) card or adapter. The networkinterface 7296 may include address, control, and/or data connections toenable appropriate communications on the network. A data store 7298 maybe used to store data. The data store 7298 may include any of volatilememory elements (e.g., random access memory (RAM, such as DRAM, SRAM,SDRAM, and the like)), nonvolatile memory elements (e.g., ROM, harddrive, tape, CDROM, and the like), and combinations thereof. Moreover,the data store 7298 may incorporate electronic, magnetic, optical,and/or other types of storage media. In one example, the data store 7298may be located internal to the server 7290, such as, for example, aninternal hard drive connected to the local interface 7282 in the server7290. Additionally, in another embodiment, the data store 7298 may belocated external to the server 7290 such as, for example, an externalhard drive connected to the I/O interfaces 7294 (e.g., SCSI or USBconnection). In a further embodiment, the data store 7298 may beconnected to the server 7290 through a network, such as, for example, anetwork-attached file server.

The memory 7280 may include any of volatile memory elements (e.g.,random access memory (RAM, such as DRAM, SRAM, SDRAM, etc.)),nonvolatile memory elements (e.g., ROM, hard drive, tape, CDROM, etc.),and combinations thereof. Moreover, the memory 7280 may incorporateelectronic, magnetic, optical, and/or other types of storage media. Notethat the memory 7280 may have a distributed architecture, where variouscomponents are situated remotely from one another but can be accessed bythe processor 7292. The software in memory 7280 may include one or moresoftware programs, each of which includes an ordered listing ofexecutable instructions for implementing logical functions. The softwarein the memory 7280 includes a suitable Operating System (O/S) 2784 andone or more programs 7286. The operating system 7284 essentiallycontrols the execution of other computer programs, such as the programs7286, and provides scheduling, input-output control, file and datamanagement, memory management, and communication control and relatedservices. The one or more programs 7286 may be configured to implementthe various processes, algorithms, methods, techniques, etc. describedherein.

FIG. 76 is a flowchart of a method 7600 for monitoring a commerciallocation. The method includes obtaining, from a camera apparatus 7220, asimultaneously captured 360 degree view captured by an array of imagesensors of the camera apparatus 7220 at step 7602. The method alsoincludes facilitating access to the captured 360 degree view to a userat step 7604. In some embodiments, the step 7604 of facilitating accessto the captured 360 degree view to a user includes providing a pluralityof images that form the combined 360 degree view around the cameraapparatus in real time by one of streaming images taken on a regularinterval and streaming video from the array of image sensors.

In embodiments, the plurality of sensors include another array of imagesensors spanning across a face thereof and arranged to capture a 180degree view of an area in front of the face. In these embodiments, themethod further includes providing two camera apparatuses 7220 mounted onopposite sides of a structure, the structure including one of a wall, adoor, and a support structure for the two camera apparatuses 7220,capturing opposing 180 degree views one each side of the structure.

In embodiments, the method 7600 also includes providing multiple imagesfrom the camera apparatus 7220 simultaneously and stitching multipleviews from the camera apparatus together.

FIG. 77 is a flowchart of a method 7700 for monitoring a commerciallocation. The method includes obtaining a data from a camera apparatus7220 including a plurality of images captured using an array of imagesensors arranged to simultaneously capture a combined 360 degree viewaround the camera apparatus 7220 at step 7702. The method 7700 alsoincludes generating a model of the commercial location using the data atstep 7704. The method 7700 further includes displaying information fromthe model within images from the combined 360 degree view to a userwhile a user is viewing the images in real time at step 7706.

FIG. 78 is a flowchart of a method 7800 for monitoring a commerciallocation. The method 7800 includes obtaining a data from a cameraapparatus including a plurality of images captured using an array ofimage sensors arranged to simultaneously capture a combined 360 degreeview around the camera apparatus and at least one of infrared sensors,sound sensors, and motion sensors at step 7802. The method 7800 alsoincludes monitoring the commercial location using the data from thearray of image sensors and the at least one of the infrared sensors, thesound sensors, and the motion sensors at step 7804.

In some embodiments, the data includes a 360 degree view ofthermographic data around the camera apparatus captured by the infraredsensors, and the method includes comparing the thermographic data to apredetermined threshold and issue an alert in response to a temperaturewithin the thermographic data being above the predetermined threshold.In some embodiments, the method further includes obtaining a pluralityof images from the combined 360 degree view around the camera apparatus7220, generating a model of the commercial location using the data,displaying information from the model within images from the combined360 degree view to a user while a user is viewing the images in realtime, and displaying thermographic information with the information fromthe model including identification of equipment being displayed alongwith an temperature of the equipment being displayed.

In embodiments, the method includes issuing an alert in response tomotion being detected by at least one of the image sensors and themotion sensors. And in some embodiments, the plurality of sensorsincludes one or more RF sensors configured to receive cellular signals,and the method further includes monitoring the cellular signals.

FIG. 79 is a flowchart of a method 7900 for monitoring a multiplelocations. The multiple locations can be at a single commercial site,such as a telecommunications site, or at multiple locations. The method7900 includes obtaining a data from the plurality of camera apparatuses7220 including a plurality of images captured using an array of imagesensors of each of the plurality of camera apparatuses 7220, the imagesensors of each of the plurality of camera apparatuses 7220 arranged tosimultaneously capture a combined 360 degree view thereabout at step7902. The method 7900 also includes determining a location for each ofthe plurality of camera apparatuses 7220 at step 7904. The method 7900further includes displaying a map with an icon identifying the locationof each of the plurality of camera apparatuses 7220 at step 7906. Themethod 7900 yet further includes displaying images from the combined 360degree view, in response to a selection of the icon of a correspondingcamera apparatus 7220 by a user, from the corresponding camera apparatus7220 selected by the user at step 7908.

In embodiments, the method 7900 also includes displaying iconsrepresenting each of the other of the plurality of camera apparatuses7220 within the 360 degree view of the corresponding camera apparatus7220 selected by the user, each of the icons being displayed in arespective image of the combined 360 degree view of images where therespective camera apparatus 7220 location is in a direction that iswithin a general direction of a field of view of a corresponding imagesensor. In some of these embodiments, the method 7900 also includesdisplaying images from the respective camera apparatus 7220 based on aselection from the icons being displayed within the 360 degree view. Assuch, a user can quickly navigate between camera apparatuses 7220without navigating back to the map to move between the image feeds ofcamera apparatuses 7220.

In some embodiments of the method 7900, each of the plurality of cameraapparatuses 7220 includes infrared sensors configured to capture a 360degree view of thermographic data thereabout. In these embodiments, themethod 7900 further includes comparing the thermographic data to apredetermined threshold and issuing an alert in response to atemperature within the thermographic data being above the predeterminedthreshold. Issuing the alert includes displaying the alert with the iconassociated with the corresponding camera apparatus on the map.

In some embodiments of the method 7900, each of the plurality of cameraapparatuses 7220 includes sound sensors configured for at least one ofcommunicating with an individual within the combined 360 degree view ofthe respective camera apparatus 7220 and monitoring sounds emanatingfrom equipment within the combined 360 degree view of each of theplurality camera apparatuses. In these embodiments, the method 7900includes issuing an alert, including displaying the alert with the iconassociated with the corresponding camera apparatus 7900, in response tothe sound sensors detecting a sound above a predetermined threshold.

Further, in embodiments of the method 7900, each of the plurality ofcamera apparatuses 7220 includes motion sensors. In these embodiments,the image sensors and the motion sensors are configured to detect motionwithin the combined 360 degree view thereabout. In these embodiments,the method 7900 further includes issuing an alert, including displayingthe alert with the icon associated with the corresponding cameraapparatus on the map, in response to motion detected by at least one ofthe image sensors and the motion sensors.

FIG. 80 is a flowchart of a method 8000 for monitoring a cell tower7300. The method 8000 includes obtaining a data from a plurality ofsensors 7226 adapted to simultaneously capture a combined 360 degreeview of at least a portion of a cell tower 7300 from a camera apparatusmounted on the cell tower 7300, the data including a plurality of imagesof the cell tower 7300 including equipment 7310 thereon at step 8002.The method also includes displaying the data from the camera apparatus7220 including the plurality of images of the cell tower 7300 includingequipment 7310 thereon to a user in real time at step 8004.

In some embodiments, the camera apparatus 7220 is configured to providea plurality of images that form the combined 360 degree view around thecamera apparatus 7220 in real time by one of streaming images taken on aregular interval and streaming video from the array of image sensors. Insome embodiments, the plurality of sensors 7226 are adapted to monitorweather around the cell tower 7300 and the data includes weather relatedinformation.

In some embodiments, the plurality of sensors 7226 includes one or moreRF sensors configured to receive cellular signals. In these embodiments,the method 8000 further includes monitoring the cellular signals of theequipment. In some embodiments, the camera apparatus 7202 is oriented tocapture a 360 degree view of a geographic region around the cell tower7300 and images of the geographic region are provided for at least oneof news, traffic, weather, and cell site conditions.

In some embodiments, the method 8000 further includes obtaining datafrom the camera apparatus including a set of images that include thecombined 360 degree view of at least the portion of the cell tower,generating a model of at least the portion of the cell tower using thedata, an displaying information from the model within the pluralityimages displayed in real time.

Although the present disclosure has been illustrated and describedherein with reference to preferred embodiments and specific examplesthereof, it will be readily apparent to those of ordinary skill in theart that other embodiments and examples may perform similar functionsand/or achieve like results. All such equivalent embodiments andexamples are within the spirit and scope of the present disclosure, arecontemplated thereby, and are intended to be covered by the followingclaims.

What is claimed is:
 1. A camera apparatus, comprising: a mounting baseadapted to mount to a structure; and a plurality of sensors including anarray of image sensors arranged to simultaneously capture a combined 360degree view around the camera apparatus.
 2. The camera apparatus ofclaim 1, wherein the array of image sensors is arranged in a circularpattern.
 3. The camera apparatus of claim 1, wherein the cameraapparatus is configured to provide a plurality of images that form thecombined 360 degree view around the camera apparatus in real time by oneof streaming images taken on a regular interval and streaming video fromthe array of image sensors.
 4. The camera apparatus of claim 1, whereinthe plurality of sensors include another array of image sensors spanningacross a face thereof and arranged to capture a 180 degree view of anarea in front of the face, and wherein two camera apparatuses areconfigured to capture opposing 180 degree views when mounted on oppositesides of a structure, the structure including one of a wall, a door, anda support structure for the two camera apparatuses.
 5. The cameraapparatus of claim 1, further comprising one or more actuators adaptedto perform at least one of retract the camera apparatus, rotate themounting base including the plurality of sensors, and tilt the mountingbase including the plurality of sensors.
 6. The camera apparatus ofclaim 1, wherein the array of image sensors are arranged in ahemispherical pattern and are adapted to capture an outwardly facingoverlapping hemispherical pattern of views with the 360 degree viewaround the camera apparatus forming a base of the hemispherical pattern.7. The camera apparatus of claim 1, wherein the camera apparatus isconfigured to provide multiple images simultaneously and is configuredto stitch multiple views together.
 8. A monitoring system for monitoringa commercial location, the monitoring system comprising: a cameraapparatus including a mounting base adapted to mount to a structure, anda plurality of sensors including an array of image sensors arranged tosimultaneously capture a combined 360 degree view around the cameraapparatus; and a server including a network interface and a processorcommunicatively coupled to one another; and memory storing instructionsthat, when executed, cause the processor to obtain the combined 360degree view around the camera apparatus and facilitate access to thecombined 360 degree view to a user.
 9. The monitoring system of claim 8,wherein the array of image sensors is arranged in a circular pattern.10. The monitoring system of claim 8, wherein the camera apparatus isconfigured to provide a plurality of images that form the combined 360degree view around the camera apparatus in real time by one of streamingimages taken on a regular interval and streaming video from the array ofimage sensors.
 11. The monitoring system of claim 8, wherein theplurality of sensors include another array of image sensors spanningacross a face thereof and arranged to capture a 180 degree view of anarea in front of the face, and wherein the monitoring system comprisestwo camera apparatuses that are configured to capture opposing 180degree views when mounted on opposite sides of a structure, thestructure including one of a wall, a door, and a support structure forthe two camera apparatuses.
 12. The monitoring system of claim 8,wherein the camera apparatus further includes one or more actuatorsadapted to perform at least one of retract the camera apparatus, rotatethe mounting base including the plurality of sensors, and tilt themounting base including the plurality of sensors.
 13. The monitoringsystem of claim 8, wherein the array of image sensors are arranged in ahemispherical pattern and are adapted to capture an outwardly facingoverlapping hemispherical pattern of views with the 360 degree viewaround the camera apparatus forming a base of the hemispherical pattern.14. The monitoring system of claim 8, wherein the memory storing theinstructions that, when executed, cause the processor to providemultiple images from the camera apparatus simultaneously and to stitchmultiple views from the camera apparatus together.
 15. A method formonitoring a commercial location, comprising: obtaining, from a cameraapparatus, a simultaneously captured 360 degree view captured by anarray of image sensors of the camera apparatus; and facilitating accessto the captured 360 degree view to a user.
 16. The method of claim 15,wherein the array of image sensors is arranged in a circular pattern.17. The method of claim 15, wherein facilitating access to the captured360 degree view to a user includes providing a plurality of images thatform the combined 360 degree view around the camera apparatus in realtime by one of streaming images taken on a regular interval andstreaming video from the array of image sensors.
 18. The method of claim15, wherein the plurality of sensors include another array of imagesensors spanning across a face thereof and arranged to capture a 180degree view of an area in front of the face, and the method furthercomprises providing two camera apparatuses mounted on opposite sides ofa structure, the structure including one of a wall, a door, and asupport structure for the two camera apparatuses, and capturing opposing180 degree views one each side of the structure.
 19. The method of claim15, wherein the array of image sensors are arranged in a hemisphericalpattern and are adapted to capture an outwardly facing overlappinghemispherical pattern of views with the 360 degree view around thecamera apparatus forming a base of the hemispherical pattern.
 20. Themethod of claim 13, further comprising providing multiple images fromthe camera apparatus simultaneously and stitching multiple views fromthe camera apparatus together.